Diurnal Aggregation Algorithm#21

Open

TinasheMTapera wants to merge 22 commits intomainfrom

Commits on Jun 26, 2025

Modify license in settings.ini to CC-BY-4.0 for publishing on dataverse resolves Add CC-BY License to the ERA5 dataset NSAPH-Data-Processing/era5_sandbox#20
TinasheMTapera
committed
[FEATURE] Begin work on publish module for ERA5 dataset pipeline to publish datasets to the harvard dataverse. Also first attempt at nbdev with quarto
TinasheMTapera
committed

Commits on Jul 2, 2025

Commits on Jul 30, 2025

Committing progress:
TinasheMTapera
committed

Commits on Jul 31, 2025

Major changes to the project including:
TinasheMTapera
committed

Commits on Aug 18, 2025

Progress towards feature/16-Add-Functionality-for-Diurnal-Readings:
TinasheMTapera
committed

Commits on Aug 28, 2025

Major refactor of aggregation framework that accurately aggregates datatypes by solar date
TinasheMTapera
committed

Commits on Sep 2, 2025

Continue progress on the algorithm. Currently, we have the values in each xarray classified and resampled, but we need to convert to raster and then aggregate by polygon... not clear how to do this…
TinasheMTapera
committed

Commits on Sep 5, 2025

Enable DEV_MODE for quick development and update aggregation logic to use DataFrame for diurnal classification.
TinasheMTapera
committed

Commits on Sep 11, 2025

Commits on Sep 15, 2025

- Corrected algorithm to use for diurnal aggregation. The task now takes a row from the jobs dataframe as input, which makes it easier to manage parameters.
TinasheMTapera
committed

Commits on Sep 17, 2025

Functioning pytask pipeline has been updated to include the diurnal algorithm
TinasheMTapera
committed

Commits on Sep 22, 2025

Major updates to run the entire workflow with diurnal readings:
TinasheMTapera
committed

Commits on Oct 2, 2025