Skip to content

Add DGGS chunked resampling#181

Open
danlooo wants to merge 11 commits intomainfrom
chunked_resampling
Open

Add DGGS chunked resampling#181
danlooo wants to merge 11 commits intomainfrom
chunked_resampling

Conversation

@danlooo
Copy link
Owner

@danlooo danlooo commented Jan 14, 2026

This PR aims to align the storage chunk with the compute chunk during to_dggs_dataset .
A for loop over DGGS chunks is used instead of mapCube, limiting required memory.

@danlooo danlooo changed the title Add chunked resampling Add DGGS chunked resampling Jan 14, 2026
@danlooo
Copy link
Owner Author

danlooo commented Jan 15, 2026

function get_chunks returns no used chunk if geo_array covers the entire earth. Edge points of global bbox all lie on just two points (poles) leading to intervals of length 0 in dggs space. Need to consider edge cases for get_chunks in which geo bbox covers multiple quads.

@danlooo
Copy link
Owner Author

danlooo commented Mar 11, 2026

Issue: to_dggs_dataset of 2048*2048 RGB geotif takes 344s at this PR but only 2.8s at main. Bottleneck: Need to Diskarrays.readblock on every geo pixel individually, despite caching already.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant