Testing of ANU-tub using different MOM versions: Jbisits (Issue: #155) #156

chrisb13 · 2025-11-10T00:58:53Z

Related: #155

This is for testing.

Note, re: 9385396:

    # used to have: - access-om3@git.2025.08.001
    # Jbisits MOM6 code https://github.com/jbisits/MOM6/commit/3612119ce778e54d0d2fe35011bf42005afd7d0c
    # =2025.07.000 means spack will use that set of dependencies to concretise
    # see https://github.com/ACCESS-NRI/spack-packages/blob/fd44ae03141eab221ce0e5b587dbb9c81d411fcb/packages/access-mom6/package.py#L27
    # link regarding the Debug flag https://spack-tutorial.readthedocs.io/en/latest/tutorial_buildsystems.html#cmake

See here for some more details on how this works.

DO NOT MERGE

🚀 The latest prerelease access-om3/pr156-6 at a9e7e80 is here: #156 (comment) 🚀

Updated access-mom6 specifications and added comments for clarity.

github-actions · 2025-11-10T01:09:27Z

🚀 Attempted to deploy access-om3 Prerelease pr156-1 with commit 9385396

🖥️ `Gadi` Deployment ❌

chrisb13 · 2025-11-10T01:17:03Z

Any thoughts on why this failed @anton-seaice?

Github action code link. Commit 9385396.

==> [2025-11-10-12:08:27.749113] Error: Terminating after first install failure: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-unroll -mtune=sapphirerapids -march=sapphirerapids' '-DCMAKE_CXX_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/spack-src'
Traceback (most recent call last):
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2118, in install
    self._install_task(task, install_status)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 1672, in _install_task
    pkg, build_process, install_args
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/build_environment.py", line 1374, in start_build_process
    raise child_result
==> [2025-11-10-12:08:05.257038] Updating view at /g/data/vk83/prerelease/apps/spack/0.22/environments/access-om3-pr156-1/.spack-env/view
spack.build_environment.ChildError: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-unroll -mtune=sapphirerapids -march=sapphirerapids' '-DCMAKE_CXX_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/spack-src'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1069, in main
    return _main(argv)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1022, in _main
    return finish_parse_and_run(parser, cmd_name, args, env_format_error)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1052, in finish_parse_and_run
    return _invoke_command(command, parser, args, unknown)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 649, in _invoke_command
    return_val = command(parser, args)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 351, in install
    install_with_active_env(env, args, install_kwargs, reporter_factory)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 420, in install_with_active_env
    env.install_specs(specs_to_install, **install_kwargs)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/environment/environment.py", line 1950, in install_specs
    PackageInstaller([spec.package for spec in specs], install_args).install()
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2169, in install
    raise InstallError(f"{fail_fast_err}: {str(exc)}", pkg=pkg)
spack.installer.InstallError: Terminating after first install failure: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-jyre7v6omd7ra4g42z27j7ozw7uhqcaf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-unroll -mtune=sapphirerapids -march=sapphirerapids' '-DCMAKE_CXX_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-pqgyp7zlgnfpzjhucqqbflqmsachw55j/spack-src'
Error: Process completed with exit code 1.

anton-seaice · 2025-11-10T02:13:54Z

1 error found in build log:
6 -- Check for working Fortran compiler: /g/data/vk83/prerelease/apps/
spack/0.22/spack/lib/spack/env/oneapi/ifx - skipped
7 CMake Warning at CMakeLists.txt:25 (message):
8 Compiler not officially supported: IntelLLVM
9
10
11 -- Could NOT find MPI_Fortran (missing: MPI_mpi_usempif08_LIBRARY MP
I_mpi_usempi_ignore_tkr_LIBRARY MPI_mpi_mpifh_LIBRARY MPI_Fortran_WO
RKS)

12 CMake Error at /apps/cmake/3.24.2/share/cmake-3.24/Modules/FindPacka
geHandleStandardArgs.cmake:230 (message):
13 Could NOT find MPI (missing: MPI_Fortran_FOUND Fortran)
14 Call Stack (most recent call first):
15 /apps/cmake/3.24.2/share/cmake-3.24/Modules/FindPackageHandleStand
ardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
16 /apps/cmake/3.24.2/share/cmake-3.24/Modules/FindMPI.cmake:1835 (fi
nd_package_handle_standard_args)
17 CMakeLists.txt:75 (find_package)
18

Appears to be failing here in generic tracers

Not sure!

chrisb13 · 2025-11-10T03:15:47Z

Thanks @anton-seaice, where and how did you find the build log?

I've also tried with @angus-g's code and it doesn't work but it seems to fail on a different error.

So even though we are doing MOM6 standalone generic tracers is included? Isn't that a bit weird?

anton-seaice · 2025-11-10T03:28:09Z

Thanks @anton-seaice, where and how did you find the build log?

Same link - just scroll up further from the bottom e.g. https://github.com/ACCESS-NRI/ACCESS-OM3/actions/runs/19217319406/job/54928851151?pr=156#step:16:1374

There's no option for building without gtracers - sorry I can't remember the history there!

@jbisits

Just trying something from `main` on the @jbisits fork https://github.com/jbisits/MOM6 (trying to test whether it's just something about not being in our org').

github-actions · 2025-11-10T04:00:51Z

🚀 Attempted to deploy access-om3 Prerelease pr156-2 with commit f10352d

🖥️ `Gadi` Deployment ❌

chrisb13 · 2025-11-10T04:15:44Z

@chrisb13 to do:

This didn't work.

f10352d
Just trying something from main on the @jbisits fork https://github.com/jbisits/MOM6 (trying to test whether it's just something about not being in our org').

Need to find a commit on Joey's repo that is also on ours and so should just work (i.e. test it isn't something weird about being on a fork)

jbisits · 2025-11-10T04:21:56Z

@chrisb13 to do:

This didn't work.

f10352d
Just trying something from main on the @jbisits fork https://github.com/jbisits/MOM6 (trying to test whether it's just something about not being in our org').

Need to find a commit on Joey's repo that is also on ours and so should just work (i.e. test it isn't something weird about being on a fork)

Let me know if there is anything I can do to help here. Happy to fork ACCESS-MOM6 and move my branch to there if that helps? It might help me because I have been trying to setup an OM3 build today with my fork (also tried with the path to the source on gadi) and was not able to get it setup so far (though that is my issue and not related to this).

chrisb13 · 2025-11-10T04:28:19Z

Thanks @jbisits, let me see how I go.

Regarding this point:

Need to find a commit on Joey's repo that is also on ours

My plan is to use git merge-base, e.g.:

git merge-base dev-MC_4km_jra_ryf+regionalpanan dev-MC_4km_jra_ryf+regionalpanan+isf
52bf0b61f8ded1e07dde5646a54cee892a378509

And on:

I have been trying to setup an OM3 build today with my fork (also tried with the path to the source on gadi) and was not able to get it setup so far (though that is my issue and not related to this).

Okay, well feel free to open an issue (probably in this repo, if it's related to building OM3 like variants), there's lots of Spack related help here.

anton-seaice · 2025-11-10T04:50:34Z

13 Could NOT find MPI (missing: MPI_Fortran_FOUND Fortran)

I can reproduce this outside spack if i use CMAKE_Fortran_COMPILER="/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/env/oneapi/ifx" but it finds OpenMPI fine if i use CMAKE_Fortran_COMPILER=mpifort

We don't normally have to specify that anywhere, so its a bit strange

jbisits · 2025-11-11T10:43:01Z

@chrisb13 with jib/numerical-mixing@6e70504 I have fixed the build errors I hit when using spack (see #158). Updating to this commit might help the spack build here.

@jbisits

Following the @jbisits [suggestion](#156 (comment)). Will try building with the re-based version (jbisits/MOM6@6e70504) Related: #158

github-actions · 2025-11-12T01:28:38Z

🚀 Attempted to deploy access-om3 Prerelease pr156-3 with commit 0d04a37

🖥️ `Gadi` Deployment ❌

chrisb13 · 2025-11-12T01:47:24Z

@chrisb13 with jib/numerical-mixing@6e70504 I have fixed the build errors I hit when using spack (see #158). Updating to this commit might help the spack build here.

H'm still didn't work unfortunately, I get

==> [2025-11-12-12:28:01.004850] InstallError: Terminating after first install failure: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-mtune=sapphirerapids -march=sapphirerapids -unroll' '-DCMAKE_CXX_FLAGS=-mtune=sapphirerapids -unroll -march=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/spack-src'
==> [2025-11-12-12:28:01.005027] Error: Terminating after first install failure: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-mtune=sapphirerapids -march=sapphirerapids -unroll' '-DCMAKE_CXX_FLAGS=-mtune=sapphirerapids -unroll -march=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/spack-src'
Traceback (most recent call last):
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2118, in install
    self._install_task(task, install_status)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 1672, in _install_task
    pkg, build_process, install_args
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/build_environment.py", line 1374, in start_build_process
    raise child_result
spack.build_environment.ChildError: ProcessError: Command exited with status 1:
==> [2025-11-12-12:27:41.732609] Updating view at /g/data/vk83/prerelease/apps/spack/0.22/environments/access-om3-pr156-3/.spack-env/view
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-mtune=sapphirerapids -march=sapphirerapids -unroll' '-DCMAKE_CXX_FLAGS=-mtune=sapphirerapids -unroll -march=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/spack-src'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1069, in main
    return _main(argv)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1022, in _main
    return finish_parse_and_run(parser, cmd_name, args, env_format_error)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1052, in finish_parse_and_run
    return _invoke_command(command, parser, args, unknown)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 649, in _invoke_command
    return_val = command(parser, args)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 351, in install
    install_with_active_env(env, args, install_kwargs, reporter_factory)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 420, in install_with_active_env
    env.install_specs(specs_to_install, **install_kwargs)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/environment/environment.py", line 1950, in install_specs
    PackageInstaller([spec.package for spec in specs], install_args).install()
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2169, in install
    raise InstallError(f"{fail_fast_err}: {str(exc)}", pkg=pkg)
spack.installer.InstallError: Terminating after first install failure: ProcessError: Command exited with status 1:
    '/apps/cmake/3.24.2/bin/cmake' '-G' 'Unix Makefiles' '-DCMAKE_INSTALL_PREFIX:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a' '-DCMAKE_BUILD_TYPE:STRING=Release' '-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' '-DCMAKE_INTERPROCEDURAL_OPTIMIZATION:BOOL=OFF' '-DCMAKE_POLICY_DEFAULT_CMP0090:STRING=NEW' '-DCMAKE_FIND_USE_PACKAGE_REGISTRY:BOOL=OFF' '-DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON' '-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON' '-DCMAKE_INSTALL_RPATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu/lib;/apps/openmpi/4.1.7/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj/lib;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo/lib64;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m/lib64' '-DCMAKE_PREFIX_PATH:STRING=/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/fms-2025.03-tprdjm7hvmienvswdypfmwcnq7twaa4d;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-fortran-4.6.1-kpafmjn6dnwlm4uauyf4iukpskyanlqj;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/netcdf-c-4.9.2-t2t46hwpfaofaffmzgg5invuqhjcqisf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/libaec-1.0.6-jcrrmtkfy4fyr5a44irjev66rbnefx2m;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/hdf5-1.14.3-4zpnxmmmwib3woeyves5g5ujqthekumo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/c-blosc-1.21.5-aumkf5f324nmiisfv72or66nh2ln2kwo;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zstd-1.5.6-u3y3yz5ohcgumfogkiiwye6j2k4qfqo4;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/zlib-ng-2.1.6-nqvthcfjko2yew2ldu27ilkhswxcdogd;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/snappy-1.1.10-qjn5whmsz6aeph6hc4g3n7k3muhuyxqg;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/lz4-1.9.4-zjkyjelpbqblwlgm6xphcp3dj66z6xi2;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/bzip2-1.0.8-tnxlpfbi2vlz2uqmwngr7z5jvetcnl77;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/access-mocsy-2025.07.002-ymzcsnrio3n2tagkvtb6yymabti5b76i;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/gmake-4.4.1-ug7cxkury2dq3xzrvilrezkbojuvai2w;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/oneapi-2025.2.0/intel-oneapi-runtime-2025.2.0-gsm6p2qsbrjruz3rx3juoa6tedqrqrhf;/g/data/vk83/prerelease/apps/spack/0.22/release/linux-rocky8-x86_64_v4/gcc-14.1.0/gcc-runtime-14.1.0-vf3ihhn5dusv3zrxrozoh7cswptn2ptu;/apps/openmpi/4.1.7;/apps/cmake/3.24.2' '-DCMAKE_C_FLAGS=-mtune=sapphirerapids -march=sapphirerapids -unroll' '-DCMAKE_CXX_FLAGS=-mtune=sapphirerapids -unroll -march=sapphirerapids' '-DCMAKE_Fortran_FLAGS=-unroll -march=sapphirerapids -mtune=sapphirerapids' '-DBUILD_SHARED_LIBS:BOOL=OFF' '/scratch/tm70/***/tmp/spack-stage/spack-stage-access-generic-tracers-2025.08.000-m7b7r53a3unultcw2h2k25ma5hoyrq4a/spack-src'
Error: Process completed with exit code 1.

@anton-seaice suggested I use 2025.07.000 of the mom6 spack package:
https://github.com/ACCESS-NRI/access-spack-packages/blob/d8b48b18a1400cf2a6850af0bf038af55804d92f/packages/access-mom6/package.py#L27

Do you know what you used @jbisits?

@harshula or @CodeGat will likely have some tips to figure out what is different between your Gadi machine build and my attempt at CI infra here..?

jbisits · 2025-11-12T01:53:30Z

I used 2025.07.000 in the spack.yaml in the development environment

develop:
    access-mom6:
        spec: access-mom6@2025.07.000
        path: /g/data/e14/jb2381/MOM6-examples/src/MOM6-nm

jbisits · 2025-11-13T00:46:17Z

@chrisb13 I am not sure if this is related to the error here (I think it is not) but thought I would mention it. When I build MOM6 with ninja, using mom6-ninja-nci, I cannot have payu loaded. This is because it tries to use a different fortran compiler, the one payu points to, than the one that is specified by mom6-ninja-nci.

chrisb13 · 2025-11-13T00:51:09Z

Thanks for following up @jbisits, an update: @anton-seaice has noticed that we have something wrong with our "online" build in general, both for mom6 standalone and om3, details:

MOM6-standalone + debug base case #160
Access-om3 sanity check #161
Presumably something changed without us noticing till now. Our Spack wizards are looking into it. My expectation is that once that is fixed we'll be able to get past the above errors but it remains to be seen if it builds without other issues.

chrisb13 · 2025-11-13T23:41:05Z

!redeploy

github-actions · 2025-11-13T23:47:37Z

🚀 Attempted to deploy access-om3 Prerelease pr156-4 with commit 0d04a37

🖥️ `Gadi` Deployment ❌

chrisb13 · 2025-11-13T23:51:45Z

H'm looks like the fixes have helped but my impression is that it can't find @jbisits fork:

==> [2025-11-14-10:47:06.998910] Updating view at /g/data/vk83/prerelease/apps/spack/0.22/environments/access-om3-pr156-4/.spack-env/view
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2118, in install
    self._install_task(task, install_status)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 1672, in _install_task
    pkg, build_process, install_args
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/build_environment.py", line 1374, in start_build_process
    raise child_result
spack.build_environment.ChildError: FetchError: All fetchers failed for spack-stage-access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000-y7gmaakv7cph7tsfduswu36c4hc2hgho
        file:///g/data/vk83/prerelease/apps/spack/0.22/buildcache/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz: URLError: <urlopen error [Errno 2] No such file or directory: '/g/data/vk83/prerelease/apps/spack/0.22/buildcache/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz'>
    file:///g/data/vk83/prerelease/apps/spack/0.22/buildcache/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz: URLError: <urlopen error [Errno 2] No such file or directory: '/g/data/vk83/prerelease/apps/spack/0.22/buildcache/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz'>
    https://mirror.spack.io/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz: DetailedHTTPError: GET https://mirror.spack.io/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz returned 404: Not Found
    https://mirror.spack.io/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz: DetailedHTTPError: GET https://mirror.spack.io/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz returned 404: Not Found
    [git] https://github.com/ACCESS-NRI/MOM6.git at commit 6e705048aa6b400ee7630ef8e2be94d415fff86f: ProcessError: Command exited with status 128:
    '/bin/git' '-c' 'advice.detachedHead=false' 'checkout' '6e705048aa6b400ee7630ef8e2be94d415fff86f'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1069, in main
    return _main(argv)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1022, in _main
    return finish_parse_and_run(parser, cmd_name, args, env_format_error)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 1052, in finish_parse_and_run
    return _invoke_command(command, parser, args, unknown)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/main.py", line 649, in _invoke_command
    return_val = command(parser, args)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 351, in install
    install_with_active_env(env, args, install_kwargs, reporter_factory)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/cmd/install.py", line 420, in install_with_active_env
    env.install_specs(specs_to_install, **install_kwargs)
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/environment/environment.py", line 1950, in install_specs
    PackageInstaller([spec.package for spec in specs], install_args).install()
  File "/g/data/vk83/prerelease/apps/spack/0.22/spack/lib/spack/spack/installer.py", line 2169, in install
    raise InstallError(f"{fail_fast_err}: {str(exc)}", pkg=pkg)
spack.installer.InstallError: Terminating after first install failure: FetchError: All fetchers failed for spack-stage-access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000-y7gmaakv7cph7tsfduswu36c4hc2hgho
        file:///g/data/vk83/prerelease/apps/spack/0.22/buildcache/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz: URLError: <urlopen error [Errno 2] No such file or directory: '/g/data/vk83/prerelease/apps/spack/0.22/buildcache/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz'>
    file:///g/data/vk83/prerelease/apps/spack/0.22/buildcache/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz: URLError: <urlopen error [Errno 2] No such file or directory: '/g/data/vk83/prerelease/apps/spack/0.22/buildcache/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz'>
    https://mirror.spack.io/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz: DetailedHTTPError: GET https://mirror.spack.io/_source-cache/git/ACCESS-NRI/MOM6.git/6e705048aa6b400ee7630ef8e2be94d415fff86f.tar.gz returned 404: Not Found
    https://mirror.spack.io/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz: DetailedHTTPError: GET https://mirror.spack.io/access-mom6/access-mom6-git.6e705048aa6b400ee7630ef8e2be94d415fff86f_2025.07.000.tar.gz returned 404: Not Found
    [git] https://github.com/ACCESS-NRI/MOM6.git at commit 6e705048aa6b400ee7630ef8e2be94d415fff86f: ProcessError: Command exited with status 128:
    '/bin/git' '-c' 'advice.detachedHead=false' 'checkout' '6e705048aa6b400ee7630ef8e2be94d415fff86f'
Error: Process completed with exit code 1.

Any idea how to fix this @CodeGat or @anton-seaice ? (My memory is that you thought there was a chance this might happen Anton?)

@CodeGat

following @CodeGat's suggestion: https://access-nri.zulipchat.com/#narrow/channel/470325-model-release/topic/.60missing.3A.20MPI_Fortran_FOUND.20.60.20in.20spack.20builds/near/555480162 (I think!)

github-actions · 2025-11-14T00:04:40Z

🚀 Attempted to deploy access-om3 Prerelease pr156-5 with commit 5b71545

🖥️ `Gadi` Deployment ❌

github-actions · 2025-11-14T00:27:02Z

🚀 Attempted to deploy access-om3 Prerelease pr156-5 with commit f65a8e6

🖥️ `Gadi` Deployment ✔️

Usage Instructions

access-om3, defined in ./spack.yaml, will be deployed to Gadi as:

6e705048aa6b400ee7630ef8e2be94d415fff86f as a Release (when merged).
pr156-5 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr156-5

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr156-5 environment.
Due to inode-saving measures, one will have to manually untar the environment metadata before environment activation with tar -xf .spack-env .spack-env.tar. It will require one to have write privileges.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version 2025.08.003
access-nri/spack-config version 2025.08.000

If the above was not what was expected, commit changes to config/versions.json in this PR.

chrisb13 · 2025-11-14T00:32:47Z

Many thanks to @harshula @CodeGat and @anton-seaice for all the help getting this thing (mostly) working!

See related chat:
#model-release > `missing: MPI_Fortran_FOUND ` in spack builds

Currently this is our status (@anton-seaice)

built a debug build. When we kind of wanted both a release and a debug build, which it hasn't done

(more tinkering needed)

fyi @jbisits

Turning this off for the time being as it's duplication/unnecessary: https://access-nri.zulipchat.com/#narrow/channel/470325-model-release/topic/.60missing.3A.20MPI_Fortran_FOUND.20.60.20in.20spack.20builds/near/555483354 see also: #160

github-actions · 2025-11-14T00:46:44Z

🚀 Attempted to deploy access-om3 Prerelease pr156-6 with commit a9e7e80

🖥️ `Gadi` Deployment ✔️

Usage Instructions

access-om3, defined in ./spack.yaml, will be deployed to Gadi as:

6e705048aa6b400ee7630ef8e2be94d415fff86f as a Release (when merged).
pr156-6 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using:

module use /g/data/vk83/prerelease/modules
module load access-om3/pr156-6

When using the above modules, the binaries shall be on your $PATH.

For advanced users, this Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.22/spack in the access-om3-pr156-6 environment.
Due to inode-saving measures, one will have to manually untar the environment metadata before environment activation with tar -xf .spack-env .spack-env.tar. It will require one to have write privileges.

Configuration Information

This Prerelease is deployed using:

access-nri/spack on branch 0.22
access-nri/spack-packages version 2025.08.003
access-nri/spack-config version 2025.08.000

If the above was not what was expected, commit changes to config/versions.json in this PR.

chrisb13 · 2025-11-14T00:49:20Z

from @anton-seaice

Its worth searching for "concretiz" in the build log from the runner and checking what it sets build_type too now

Okay, so on

the one (f65a8e6) where we had both lines, I think it's build_type=Debug
the one (a9e7e80) where we had only one line without the debug, I think it's build_type=Release

Am I looking in the right places? Just guessing the deploy to gadi prerelease is the right bit.

Is that what you were expecting?

Related: #160

Modify access-mom6 specs and add comments

9385396

Updated access-mom6 specifications and added comments for clarity.

chrisb13 had a problem deploying to Gadi Prerelease November 10, 2025 00:59 — with GitHub Actions Failure

chrisb13 changed the title ~~Testing of ANU-tub using different MOM versions (#155)~~ Testing of ANU-tub using different MOM versions: Jbisits (#155) Nov 10, 2025

chrisb13 changed the title ~~Testing of ANU-tub using different MOM versions: Jbisits (#155)~~ Testing of ANU-tub using different MOM versions: Jbisits (Issue: #155) Nov 10, 2025

Update access-mom6 git commit reference in spack.yaml

f10352d

Just trying something from `main` on the @jbisits fork https://github.com/jbisits/MOM6 (trying to test whether it's just something about not being in our org').

chrisb13 had a problem deploying to Gadi Prerelease November 10, 2025 03:53 — with GitHub Actions Failure

chrisb13 mentioned this pull request Nov 10, 2025

Testing of ANU-tub using different MOM versions #155

Open

jbisits mentioned this pull request Nov 11, 2025

Building and running OM3 with modified MOM6 source code #158

Closed

Update spack.yaml

0d04a37

Following the @jbisits [suggestion](#156 (comment)). Will try building with the re-based version (jbisits/MOM6@6e70504) Related: #158

chrisb13 had a problem deploying to Gadi Prerelease November 12, 2025 01:21 — with GitHub Actions Failure

chrisb13 mentioned this pull request Nov 13, 2025

Adding ANU-TUB to configurations ACCESS-Community-Hub/access-iom3-configs#4

Open

Update spack.yaml

5b71545

following @CodeGat's suggestion: https://access-nri.zulipchat.com/#narrow/channel/470325-model-release/topic/.60missing.3A.20MPI_Fortran_FOUND.20.60.20in.20spack.20builds/near/555480162 (I think!)

Update indentation

f65a8e6

CodeGat temporarily deployed to Gadi Prerelease November 14, 2025 00:13 — with GitHub Actions Inactive

Update spack.yaml

a9e7e80

Turning this off for the time being as it's duplication/unnecessary: https://access-nri.zulipchat.com/#narrow/channel/470325-model-release/topic/.60missing.3A.20MPI_Fortran_FOUND.20.60.20in.20spack.20builds/near/555483354 see also: #160

chrisb13 temporarily deployed to Gadi Prerelease November 14, 2025 00:34 — with GitHub Actions Inactive

chrisb13 mentioned this pull request Nov 28, 2025

Add anu-tub setup to configurations page ACCESS-Community-Hub/access-iom3-configs#10

Open

Testing of ANU-tub using different MOM versions: Jbisits (Issue: #155) #156

Are you sure you want to change the base?

Testing of ANU-tub using different MOM versions: Jbisits (Issue: #155) #156

Uh oh!

Conversation

chrisb13 commented Nov 10, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 10, 2025

🖥️ Gadi Deployment ❌

Uh oh!

chrisb13 commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

anton-seaice commented Nov 10, 2025

Uh oh!

chrisb13 commented Nov 10, 2025

Uh oh!

anton-seaice commented Nov 10, 2025

Uh oh!

github-actions bot commented Nov 10, 2025

🖥️ Gadi Deployment ❌

Uh oh!

chrisb13 commented Nov 10, 2025

Uh oh!

jbisits commented Nov 10, 2025

Uh oh!

chrisb13 commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

anton-seaice commented Nov 10, 2025

Uh oh!

jbisits commented Nov 11, 2025

Uh oh!

github-actions bot commented Nov 12, 2025

🖥️ Gadi Deployment ❌

Uh oh!

chrisb13 commented Nov 12, 2025

Uh oh!

jbisits commented Nov 12, 2025

Uh oh!

jbisits commented Nov 13, 2025

Uh oh!

chrisb13 commented Nov 13, 2025

Uh oh!

chrisb13 commented Nov 13, 2025

Uh oh!

github-actions bot commented Nov 13, 2025

🖥️ Gadi Deployment ❌

Uh oh!

chrisb13 commented Nov 13, 2025

Uh oh!

github-actions bot commented Nov 14, 2025

🖥️ Gadi Deployment ❌

Uh oh!

github-actions bot commented Nov 14, 2025

🖥️ Gadi Deployment ✔️

Uh oh!

chrisb13 commented Nov 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 14, 2025

🖥️ Gadi Deployment ✔️

Uh oh!

chrisb13 commented Nov 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

chrisb13 commented Nov 10, 2025 •

edited by github-actions bot

Loading

🖥️ `Gadi` Deployment ❌

chrisb13 commented Nov 10, 2025 •

edited

Loading

🖥️ `Gadi` Deployment ❌

chrisb13 commented Nov 10, 2025 •

edited

Loading

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ❌

🖥️ `Gadi` Deployment ✔️

chrisb13 commented Nov 14, 2025 •

edited

Loading

🖥️ `Gadi` Deployment ✔️

chrisb13 commented Nov 14, 2025 •

edited

Loading