Ci cd - DO NOT SUBMIT, attempt 2#12

Open

marymcglo wants to merge 74 commits intomainfrom

Commits on Apr 10, 2025

Commits on Apr 11, 2025

Commits on Apr 16, 2025

Commits on Apr 23, 2025

adapt checkpoint saving and loading
PetarStam
committed

Commits on Apr 28, 2025

Commits on Apr 29, 2025

Commits on May 7, 2025

Commits on May 9, 2025

add small loggign changes
Petar Stamenkovic
committed
adapt sbatch script to slurm config
Petar Stamenkovic
committed
adapt era5cosmo loader to trim_edge 19
Petar Stamenkovic
committed

Commits on May 12, 2025

add inference
PetarStam
committed
Plot absolute error onto a projection for a given date

Mary McGlohon
authored and
Mary McGlohon
committed
Adjust how reshaping is done before error calcs

Mary McGlohon
authored and
Mary McGlohon
committed
plot for all channels, and against baseline

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on May 13, 2025

Add MAE output

Mary McGlohon
authored and
Mary McGlohon
committed
Fix indexing error

Mary McGlohon
authored and
Mary McGlohon
committed
Merge branch 'corr-diff' of https://github.com/MeteoSwiss/HiRAD-Gen into corr-diff

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on May 14, 2025

Try adding spectral graph

Mary McGlohon
authored and
Mary McGlohon
committed
Start some CE stuff

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on May 15, 2025

fix inference for diffusion
Petar Stamenkovic
committed
Merge remote-tracking branch 'origin/corr-diff' into corr-diff
Petar Stamenkovic
committed
clean up
Petar Stamenkovic
committed
Add power spectrum plots

Mary McGlohon
authored and
Mary McGlohon
committed
Merge branch 'corr-diff' of https://github.com/MeteoSwiss/HiRAD-Gen into corr-diff

Mary McGlohon
authored and
Mary McGlohon
committed
clean up a bit

Mary McGlohon
authored and
Mary McGlohon
committed
clean up a bit

Mary McGlohon
authored and
Mary McGlohon
committed
add readme for training
Petar Stamenkovic
committed
Merge remote-tracking branch 'origin/corr-diff' into corr-diff
Petar Stamenkovic
committed

Commits on May 16, 2025

Merge branch 'corr-diff' of https://github.com/MeteoSwiss/HiRAD-Gen into corr-diff

Mary McGlohon
authored and
Mary McGlohon
committed
update readme for inference
Petar Stamenkovic
committed
Merge remote-tracking branch 'origin/corr-diff' into corr-diff
Petar Stamenkovic
committed
small fix for inference on multiple time steps
Petar Stamenkovic
committed

Commits on May 21, 2025

enable validation during training
Petar Stamenkovic
committed

Commits on May 22, 2025

change generate eval to new functions
Petar Stamenkovic
committed
Add pytorch toml files

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on May 23, 2025

fix average training loss tracking
Petar Stamenkovic
committed
fix validation bug
Petar Stamenkovic
committed

Commits on May 26, 2025

update to latest corrdiff version
Petar Stamenkovic
committed
small config fix
Petar Stamenkovic
committed

Commits on May 27, 2025

fix generation on distributed
Petar Stamenkovic
committed
delete unnecessary logging
Petar Stamenkovic
committed
delete unnecessary logging

Petar Stamenkovic
authored and
Mary McGlohon
committed
Merge remote-tracking branch 'origin/corr-diff' into ci_cd

Mary McGlohon
authored and
Mary McGlohon
committed
new image

Mary McGlohon
authored and
Mary McGlohon
committed
use absolute path

Mary McGlohon
authored and
Mary McGlohon
committed
cd to /src

Mary McGlohon
authored and
Mary McGlohon
committed
add USE_NCCL variable to pipeline

Mary McGlohon
authored and
Mary McGlohon
committed
Attempting adding more variables

Mary McGlohon
authored and
Mary McGlohon
committed
add env logging

Mary McGlohon
authored and
Mary McGlohon
committed
Try distributed torch

Mary McGlohon
authored and
Mary McGlohon
committed
distributed test

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on May 28, 2025

run training from ci/cd.

Mary McGlohon
authored and
Mary McGlohon
committed
Split Dockerfile so we have differnet environments, to keep the CI one light. (Note: May need to change webhook command to take the new docker file)

Mary McGlohon
authored and
Mary McGlohon
committed

Commits on Jun 5, 2025

update dockerfile

Mary McGlohon
authored and
Mary McGlohon
committed
Adding back Dockerfile to see if that causes webhook to work

Mary McGlohon
authored and
Mary McGlohon
committed
Re-delete Dockerfile, don't need it.

Mary McGlohon
authored and
Mary McGlohon
committed