Add cross-platform dataset download tools - Fixes #607 #637
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Update aiohttp to address potential security vulnerabilities - Maintains compatibility with existing codebase - Addresses dependency security recommendations
- Add comprehensive open-source-resources.md with organized dataset links - Update README.md with dedicated datasets section for better navigation - Include external repository links and clear access instructions - Improve reproducibility and research collaboration Fixes google-deepmind#608
- Apply edge residual connections before node processing per paper - Node updates now use updated edge features instead of update deltas - Ensures proper information flow: e'_ij = e_ij + MLP(e_ij, v_i, v_j) - Then: v'_i = v_i + MLP(v_i, sum(e'_ij)) using updated edges - Matches mathematical formulation in MeshGraphNets paper Fixes google-deepmind#609
- Add Python script (download_dataset.py) with progress bars and resume capability - Add PowerShell script (download_dataset.ps1) for Windows native support - Update README.md with cross-platform download instructions - Addresses Issue google-deepmind#607: Unable to access datasets for Learning to Simulate Project The original bash script works but has limitations on Windows systems. These additional tools provide: - Cross-platform compatibility (Python works everywhere) - Progress indicators for large downloads - Resume capability for interrupted downloads - Better error handling and user feedback - Windows PowerShell native support All tools download from the same Google Cloud Storage URLs and maintain compatibility with the existing dataset structure.
|
Dooray! Failure Notice
Failure Notice
Your message sent to
***@***.***)
has failed to be delivered.
Please refer to the below for details.
* Recipient :
***@***.***)
* Sent time :
2025-08-11T03:50:48
* Subject :
[google-deepmind/deepmind-research] Add cross-platform dataset download tools - Fixes #607 (PR #637)
* Remote host said :
Your mail was denied from the receiver.
This message was sent from a notification-only address that cannot accept incoming email.
For more information, please contact ***@***.***
© Dooray!.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Problem
Issue #607 reported that users can't access datasets for the Learning to Simulate project. The original bash script works on Linux/Mac but many users on Windows face issues with bash compatibility and lack of progress feedback during large downloads.
Solution
Added two new download tools to complement the existing bash script:
📦 Python Script (
download_dataset.py)🪟 PowerShell Script (
download_dataset.ps1)Changes Made
download_dataset.pywith requests library and tqdm progress barsdownload_dataset.ps1with native PowerShell download functionsUsage Examples