Skip to content

AssertionError downloading ERA5 forcing data #25

@mvhulten

Description

@mvhulten
vanhulten1@jrlogin09:.../testing/eCLM_static-file-gen.25409/mkforcing$ ./download_ERA5_input_wrapper.sh 
Processing month: 2017-07
2025-04-09 16:22:38,175 INFO [2024-09-26T00:00:00] Watch our [Forum](https://forum.ecmwf.int/) for Announcements, news and other discussed topics.
2025-04-09 16:22:38,176 WARNING [2024-06-16T00:00:00] CDS API syntax is changed and some keys or parameter names may have also changed. To avoid requests failing, please use the "Show API request code" tool on the dataset Download Form to check you are using the correct syntax for your API request.
2025-04-09 16:22:38,600 INFO Request ID is f14428fb-3ac8-47f0-8450-130a99728073
2025-04-09 16:22:38,659 INFO status has been updated to accepted
2025-04-09 16:22:47,125 INFO status has been updated to running

2025-04-09 16:26:58,755 INFO status has been updated to successful
Traceback (most recent call last):                                                   
  File "/p/scratch/cdetect/vanhulten1/testing/eCLM_static-file-gen.25409/mkforcing/download_ERA5_input.py", line 80, in <module>
    generate_datarequest(year, monthstr, days)
  File "/p/scratch/cdetect/vanhulten1/testing/eCLM_static-file-gen.25409/mkforcing/download_ERA5_input.py", line 53, in generate_datarequest
    client.retrieve(dataset, request, target)
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/datapi/legacy_api_client.py", line 179, in retrieve
    return submitted if target is None else submitted.download(target)
                                            ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/datapi/processing.py", line 726, in download
    robust_download(url, target)
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/multiurl/http.py", line 479, in wrapped
    r = call(main_url, *args, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/datapi/processing.py", line 692, in _download
    multiurl.download(
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/multiurl/downloader.py", line 111, in download
    return Downloader(url, **kwargs).download(target)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/p/home/jusers/vanhulten1/jureca/.local/lib/python3.11/site-packages/multiurl/base.py", line 135, in download
    os.path.getsize(download) == size
AssertionError: File size mismatch 119446336 bytes instead of 348329709

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions