Skip to content

Debugging non-reproducibility of ACCESS-NRI 0.3.1 -> 0.4.0#47

Closed
dougiesquire wants to merge 7 commits intomainfrom
debug-0.4.0-non-repro
Closed

Debugging non-reproducibility of ACCESS-NRI 0.3.1 -> 0.4.0#47
dougiesquire wants to merge 7 commits intomainfrom
debug-0.4.0-non-repro

Conversation

@dougiesquire
Copy link
Collaborator

@dougiesquire dougiesquire commented Feb 13, 2025

This is a PR to debug and document where we lost reproducibility when we updated from 0.3.1 to 0.4.0. The context is that our repro tests had a bug and was effectively always reporting reproducible runs. We thus updated components from 0.3.1 to 0.4.0 under the impression that the updates were not answer-changing when in fact they are.

Companion PR to ACCESS-NRI/access-om3-configs#173. See also https://github.com/COSIMA/access-om3/issues/266


🚀 The latest prerelease access-om3/pr47-11 at 9382009 is here: #47 (comment) 🚀

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-4 with commit 7c5e785

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-4 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-4

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-4 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-5 with commit 3b9af3e

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-5 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-5

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-5 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-6 with commit c7b673d

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-6 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-6

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-6 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@github-actions
Copy link

github-actions bot commented Feb 13, 2025

🚀 Attempted to deploy access-om3 Prerelease pr47-7 with commit 06046a0

🖥️ Gadi Deployment ❌

This was a failure due to timeouts while trying to obtain locks, so just redeployed below

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-8 with commit 06046a0

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-8 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-8

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-8 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

…versions used in 0.4.0

Unfortunately, the new versions of CMEPS/CDEPS require updating ESMF and the old versions don't work with the updated ESMF. This makes it very difficult to test just updating ESMF
@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-9 with commit 3de4fe9

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-9 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-9

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-9 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-10 with commit ce6d7c1

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-10 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-10

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-10 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.01.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@github-actions
Copy link

🚀 Attempted to deploy access-om3 Prerelease pr47-11 with commit 9382009

🖥️ Gadi Deployment ✔️

Usage Instructions

This access-om3 model will be deployed to Gadi as:

  • 2025.01.0 as a Release (when merged).
  • pr47-11 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr47-11

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr47-11 environment.

Configuration Information

This Prerelease is deployed using:

  • access-nri/spack on branch 0.22
  • access-nri/spack-packages version 2024.07.08
  • access-nri/spack-config version 2025.02.1

If the above was not what was expected, commit changes to config/versions.json in this PR.

@dougiesquire
Copy link
Collaborator Author

Closing as this has served its purpose.

@dougiesquire dougiesquire deleted the debug-0.4.0-non-repro branch April 3, 2025 05:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant