Implement DWD Weather Data Processing

[yeswanth244]

Right now, the project processes Met Office and GFS weather data, but DWD (Deutscher Wetterdienst) data isn’t implemented yet.

The file src/open_data_pvnet/nwp/dwd.py exists, but it just has a NotImplementedError, meaning it's not actually doing anything. Also, there’s no dwd_data_config.yaml, so there’s no structured way to load DWD data.

Since DWD provides open ICON model weather data (DWD Open Data Portal), we could integrate it into the pipeline to make the model even better.

If everything seems fine, please assign me this issue and add all relevant tags for GSoC so I can start working on it.

[Yuvraajb]

Hi @maintainers,

I've started working on integrating DWD (Deutscher Wetterdienst) data into the pipeline. Here's what I've done so far:

Implemented the DWDDataSource module (dwd.py), following the project's pattern for numerical weather prediction (NWP) data sources.
Created a structured dwd_data_config.yaml file for configuring DWD data parameters, variable mappings, and processing options.
Ensured compatibility with existing Met Office and GFS data processing by maintaining a standardized format.
Developed initial test cases to validate data integrity and integration with the pipeline.

Thanks!

[jcamier]

@Yuvraajb thank you for your interest in contributing. @prasanna1504 just completed this issue. Can you please test locally and compare the results with what we currently have on hugging face? Let us know of any differences you may find.
https://huggingface.co/datasets/openclimatefix/dwd-icon-eu