Skip to content

DAS-2293: nudge memory limit from 20Gi to 24Gi for smap-l2-gridder#691

Closed
flamingbear wants to merge 1 commit intomainfrom
mhs/DAS-2293/increase-smap-l2-gridder-limit-for-SPL2SMA
Closed

DAS-2293: nudge memory limit from 20Gi to 24Gi for smap-l2-gridder#691
flamingbear wants to merge 1 commit intomainfrom
mhs/DAS-2293/increase-smap-l2-gridder-limit-for-SPL2SMA

Conversation

@flamingbear
Copy link
Copy Markdown
Member

@flamingbear flamingbear commented Feb 5, 2025

The SPL2SMA is a 3km grid with almost 70 variables which requires a lot of memory to process.

Jira Issue ID

DAS-2293

Description

In testing the SPL2SMA collection against the smap-l2-gridder with Harmony-In-A-Box I found I was just nosing over 20Gi, this memory setting should suffice for testing Harmony-In-A-Box.

Local Test Steps

  • Ensure your resources for your docker desktop / k8 cluster have more than 24Gi available.
  • Build the smap-l2-gridder service image from the development branch
  • Bootstrap Harmony-In-A-Box with this branch.

Run a request that will trigger the smap-l2-gridder for the SPL2SMA collection and ensure it completes:

http://localhost:3000/C1268429729-EEDTEST/ogc-api-coverages/1.0.0/collections/parameter_vars/coverage/rangeset?forceAsync=true&outputcrs=EPSG%3A4326&granuleId=G1268429743-EEDTEST&format=application%2Fx-netcdf4&variable=all

(or you can just merge it since it's just changing an environmental variable)

PR Acceptance Checklist

  • [N/A] Acceptance criteria met
  • [N/A] Tests added/updated (if needed) and passing
  • [N/A] Documentation updated (if needed)
  • Harmony in a Box tested? (if changes made to microservices)

The SPL2SMA is a 3km grid with almost 70 variables which requires a lot of
memory to process.
@flamingbear flamingbear marked this pull request as draft February 6, 2025 00:44
@flamingbear
Copy link
Copy Markdown
Member Author

I actually think I found a way to decrease my memory use and write the file in pieces. This may be updated to drop the memory footprint

@flamingbear
Copy link
Copy Markdown
Member Author

Will submit a different one with lower memory requirements.

@flamingbear flamingbear closed this Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant