Skip to content

dask_GDL#575

Open
MarjanAsgari wants to merge 38 commits intoNRCan:developfrom
MarjanAsgari:develop
Open

dask_GDL#575
MarjanAsgari wants to merge 38 commits intoNRCan:developfrom
MarjanAsgari:develop

Conversation

@MarjanAsgari
Copy link

Thank you for submitting your PR and helping us with GDL.
Please read the template below, fill it out as appropriate, and make additional changes to your code as needed.
Please feel free to submit your PR even if it doesn't satisfy all of the requirements below.
If you need assistance or review from a maintainer, add the label Status: Help Needed or Status: Review Needed respectively.
After review, a maintainer will add the label Status: Revision Needed if further work is required for the PR to be merged.

Description

This PR intends to include dask for image contrast enhancement to speed up the pre-processing step.
In addition, it has removed the download step of reading stack data and instead it is streaming data directly to arrays.
Dependencies are:

  • dask-image>=2024.5.3
  • dask>= 2024.6.2
  • pims>=0.7
  • requests>=2.32.3

Type of change

What types of changes does your code introduce? Put an x in all the boxes that apply:

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Upgrading some features

How Has This Been Tested?

Testing part is an ongoing step.

Checklist:

If you're unsure about any of these, don't hesitate to ask. We're here to help!

  • My code follows the code style of this project
  • I have performed a self-review of my own code
  • My PR has a descriptive title
  • My code follows PEP8 (most of it)
  • My code have the proper documentation in the code
  • I have made corresponding changes to the documentation (if applicable)
  • [ x] My changes generate no new errors
  • My code is covered by the existing tests (if applicable)
  • My code includes tests that show that my feature works
  • My PR passes Travis CI tests

If your PR does not fulfill all of the requirements in the checklist above, that's OK! If you need help, @-mention a maintainer and/or add the Status: Help Needed label.

@MarjanAsgari
Copy link
Author

MarjanAsgari commented Aug 8, 2024

@remtav Thank you for the comments, for some odd reason, when I was adding the big log files to the .gitignore, it wasn't ignoring them and adding to the repo. I had to close that PR and open a new file with adding description to it as well. The clean commit for review b952c1a

CharlesAuthier
CharlesAuthier previously approved these changes Aug 8, 2024
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you think an RGBN test can be useful?

logging.info(f'\nReading image: {aoi.aoi_id}')
raster = aoi.raster
geo_inference(raster, tiff_name=aoi.aoi_id, patch_size=chunk_size)
geo_inference(tiff_image=str(aoi.raster_name), patch_size=chunk_size)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Geo_inference call does not have the argument tiff_image but rather inference_input
https://github.com/NRCan/geo-inference/blob/main/geo_inference/geo_inference.py#L103

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants