Skip to content

Commit 77c01cb

Browse files
authored
Merge pull request #1485 from CliMA/js/rm-nightly-cmip
rm nightly CMIP run
2 parents e365295 + 3a64cbd commit 77c01cb

File tree

4 files changed

+17
-48
lines changed

4 files changed

+17
-48
lines changed

.buildkite/README.md

Lines changed: 12 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -37,17 +37,20 @@ manually triggered to reset the depot.
3737
# [ClimaCoupler - Coarse Nightly AMIP](https://buildkite.com/clima/climacoupler-coarse-nightly-amip)
3838
- Scheduled daily Sunday-Thursday at 6pm PST (2am UTC +1 day)
3939
- Walltime (approx.): 12 hours
40-
- Runs on Caltech Clima node (4 GPUs)
40+
- Runs on Caltech Clima node (3 GPUs)
4141
- Configuration file location: `config/nightly_configs/`
4242

43-
This pipeline runs nightly on weekdays and uses one configuration which specifies
44-
a coarse AMIP running for 1+ years. The pipeline triggers 4 runs using this configuration,
45-
each on 1 GPU.
46-
Each run sets its own random seed so the simulations vary slightly, which allows us to more
47-
robustly test the stability of the simulations. The random seed of each simulation
48-
is printed so they can be reproduced, and 1 of the 4 runs always uses the same seed.
49-
50-
This pipeline runs with the main branches of all major CliMA packages and its main goal is
43+
This pipeline runs nightly on Monday - Thursday (4x per week), and uses 3 atmospheric
44+
configurations of interest:
45+
- diagnostic EDMF
46+
- prognostic EDMF
47+
- ED only (no convection)
48+
All configurations use 0-moment microphysics and bucket land.
49+
They run for 15 months, 6 months, and 27 months, respectively.
50+
These simulation lengths are chosen with the goal of each simulation finishing
51+
within 14 hours of wallclock time, so they can successfully run overnight.
52+
53+
This pipeline uses the main branches of many CliMA packages and its main goal is
5154
the goal to monitor stability of a coarse AMIP simulation and to catch potential problems
5255
early. This pipeline is scheduled, but it can also be used to test out configuration changes
5356
in a smaller test case before running higher resolution global AMIP runs.

.buildkite/nightly/pipeline.yml

Lines changed: 1 addition & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -29,8 +29,6 @@ steps:
2929
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(Pkg.PackageSpec(;name=\"Thermodynamics\", rev=\"main\"))'"
3030
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(Pkg.PackageSpec(;name=\"SurfaceFluxes\", rev=\"main\"))'"
3131
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(Pkg.PackageSpec(;name=\"RRTMGP\", rev=\"main\"))'"
32-
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(Pkg.PackageSpec(;name=\"Oceananigans\", rev=\"main\"))'"
33-
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(Pkg.PackageSpec(;name=\"ClimaOcean\", rev=\"main\"))'"
3432
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.resolve()'"
3533

3634
- "julia --project=experiments/ClimaEarth/ -e 'using Pkg; Pkg.add(\"MPI\")'"
@@ -46,7 +44,7 @@ steps:
4644

4745
- wait
4846

49-
- group: "Coarse AMIPs and CMIPs"
47+
- group: "Coarse AMIPs"
5048

5149
steps:
5250

@@ -94,18 +92,3 @@ steps:
9492
slurm_cpus_per_task: 4
9593
slurm_ntasks: 1
9694
slurm_mem: 30GB
97-
98-
- label: "Coarse CMIP"
99-
key: "cmip"
100-
command:
101-
- echo "--- Run simulation"
102-
- "julia --threads=3 --color=yes --project=experiments/ClimaEarth/ experiments/ClimaEarth/run_amip.jl --config_file $CONFIG_PATH/cmip_coarse.yml --job_id cmip_coarse"
103-
artifact_paths: "experiments/ClimaEarth/output/cmip_coarse/artifacts/*"
104-
timeout_in_minutes: 840
105-
env:
106-
CLIMACOMMS_DEVICE: "CUDA"
107-
agents:
108-
slurm_gpus_per_task: 1
109-
slurm_cpus_per_task: 4
110-
slurm_ntasks: 1
111-
slurm_mem: 30GB

NEWS.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,10 @@ ClimaCoupler.jl Release Notes
66

77
### ClimaCoupler features
88

9+
#### Remove coarse nightly CMIP PR[#1485](https://github.com/CliMA/ClimaCoupler.jl/pull/1485)
10+
To avoid depending on the main branch of too many packages in the nightly pipeline,
11+
we remove the CMIP nightly run and will only test AMIP nightly.
12+
913
#### Use JuliaFormatter; remove .dev folder PR[#1484](https://github.com/CliMA/ClimaCoupler.jl/pull/1484)
1014
Use JuliaFormatter to format the repo, rather than the previous `.dev/juliaformat.jl`.
1115
The `.dev/` folder is removed, and a documentation page about contributing to

config/nightly_configs/cmip_coarse.yml

Lines changed: 0 additions & 21 deletions
This file was deleted.

0 commit comments

Comments
 (0)