Skip to content

Deduplicate published jobs using STAC catalog - #338

Merged
jhkennedy merged 5 commits into
developfrom
stac-deduplication
Mar 4, 2026
Merged

Deduplicate published jobs using STAC catalog#338
jhkennedy merged 5 commits into
developfrom
stac-deduplication

Conversation

@jhkennedy

Copy link
Copy Markdown
Contributor

This also:

  • No longer de-duplicates using the S3 bucket because that method doesn't work for Sentinel-1 with unpredictable SAFE names from burst2safe.
  • refactors all HyP3 ITS_LIVE functionality into a hyp3.py module
  • refactors all Sentinel-1 specific functionality into the sentinel1.py module
  • Added stub unit test functions for all missing tests, but I plan to circle back here: Increase test coverage #337

resolves #331

@jhkennedy
jhkennedy marked this pull request as ready for review March 4, 2026 22:13
@jhkennedy
jhkennedy requested a review from a team as a code owner March 4, 2026 22:13
@jhkennedy
jhkennedy merged commit 59e5c25 into develop Mar 4, 2026
11 checks passed
@jhkennedy
jhkennedy deleted the stac-deduplication branch March 4, 2026 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update its-live-monitoring to use the stac catalog for deduplication instead of looking in the s3 bucket

1 participant