Merged
Conversation
samlamont
added a commit
that referenced
this pull request
Sep 15, 2025
* fix fetching usgs daily dv * version bump
samlamont
added a commit
that referenced
this pull request
Sep 19, 2025
* evaluation migration playground * 0.6.0dev0 version * version file error messages * clone iceberg template * remove global var * upgrade existing evaluation * iceberg io wip * iceberg writes and read * initial iceberg IO * fixing tests * convert evaluation updates * add null-safe equality for append and upsert; test updates * updates * sedona snapshot integration * add jar to lfs * config tests * optional s3 read access * fix test * update ev.sql to require views list * cleanup * writer class wip * remove playground test file * set s3 access to True by default for tests * update migrate * writer class wip * writer wip * rename class * remove writes from base table * fix location table writes * fix fetching usgs daily dv (#530) * fix fetching usgs daily dv * version bump * implement extract class * extract files in parallel * option to extract timeseries concurrently * get output filenames when parallel=True * fix create_or_replace writes * fix fetch writes * cleanup * validator class * use validator when extracting to cache * list tables and views; write to_view() * update spark config to official sedona and iceberg releases, include geotools for raster ops * config update * update remove spark jar * write parquet to cache using pyarrow schema * fix geopandas case * use write.to_cache() for fetched data * fix fetching tests * fix generate * fix test * fix clone from s3 writes * workflow class; base table cleanup * fix read from warehouse * cleanup * add joined_timeseries to initial schema and conversion script * fix convert_to_iceberg to run as script * script updates * only trigger docs and tests on pr to main * rename validation methods * fix test
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.