Skip to content

Add lazy support in pantarhei reader#462

Open
ericpre wants to merge 2 commits intohyperspy:mainfrom
ericpre:lazy_loading_pantarhei
Open

Add lazy support in pantarhei reader#462
ericpre wants to merge 2 commits intohyperspy:mainfrom
ericpre:lazy_loading_pantarhei

Conversation

@ericpre
Copy link
Member

@ericpre ericpre commented Dec 6, 2025

@tensionhead, @gguzzina when reviewing #459, I thought it would be a good time to adding lazy support compatible with the dask distributed scheduler, that is not the case of the numpy memory-map functionality. Do you want to review this PR, please?

Progress of the PR

  • Add lazy support compatible with dask distributed scheduler in pantarhei reader,
  • update docstring (if appropriate),
  • update user guide (if appropriate),
  • add a changelog entry in the upcoming_changes folder (see upcoming_changes/README.rst),
  • Check formatting of the changelog entry (and eventual user guide changes) in the docs/readthedocs.org:rosettasciio build of this PR (link in github checks)
  • add tests,
  • ready for review.

@codecov
Copy link

codecov bot commented Dec 6, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.25%. Comparing base (3ad9b03) to head (b3ec05d).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #462      +/-   ##
==========================================
+ Coverage   88.24%   88.25%   +0.01%     
==========================================
  Files         108      108              
  Lines       12207    12221      +14     
  Branches     2256     2256              
==========================================
+ Hits        10772    10786      +14     
  Misses        904      904              
  Partials      531      531              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ericpre ericpre added this to the v0.12 milestone Dec 6, 2025
@ericpre ericpre force-pushed the lazy_loading_pantarhei branch 2 times, most recently from 8bddcc7 to 2cea284 Compare December 23, 2025 09:50
@ericpre ericpre modified the milestones: v0.12, v0.13 Dec 28, 2025
@ericpre ericpre force-pushed the lazy_loading_pantarhei branch from 2cea284 to b3ec05d Compare February 24, 2026 09:03
@tensionhead
Copy link

@ericpre happy to review!

@ericpre
Copy link
Member Author

ericpre commented Feb 25, 2026

@tensionhead, please go ahead. There are some information about "distributed memory mapping" in https://hyperspy.org/rosettasciio/user_guide/lazy.html#distributed-loading.

@tensionhead
Copy link

@ericpre I can't assign myself as reviewer it seems

@ericpre
Copy link
Member Author

ericpre commented Feb 25, 2026

We don't use the assign feature of GitHub, and you can simply go to the "Files changes" tab to add comments on the code and submit your review:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants