Skip to content

Conversation

@mx-moth
Copy link
Contributor

@mx-moth mx-moth commented Sep 2, 2025

There is no nice way to index when taking a transect, it is essentially random access. Loading the data before indexing will make it faster, but loading the entire animation dataset can fail if remote servers have request size limits. By loading the data frame by frame we reach a middle ground: the data will still be indexed relatively quickly but remote servers won't baulk at sending half a gig of data at a time.

@mx-moth mx-moth self-assigned this Sep 2, 2025
@mx-moth
Copy link
Contributor Author

mx-moth commented Sep 2, 2025

NH4_transect_20220101130000_20220201130000.mp4

Copy link
Collaborator

@david-sh-csiro david-sh-csiro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested locally with both automatic and manually specified clim. We no longer receive errors from the thredds server with regards to request too large a size of data. Doing something like the K'gari transect example as an animation now actually completes!

@mx-moth mx-moth merged commit e5083f7 into main Sep 4, 2025
15 checks passed
@mx-moth mx-moth deleted the transect-data-loading branch September 4, 2025 05:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants