Skip to content

CI

CI #6113

Triggered via schedule August 12, 2026 06:25
Status Failure
Total duration 11h 21m 48s
Artifacts 29

ci.yaml

on: schedule
metadata
5s
metadata
bump-manifest
33s
bump-manifest
amd64  /  ...  /  build-base
3m 58s
amd64 / build-base / build-base
arm64  /  ...  /  build-base
4m 7s
arm64 / build-base / build-base
amd64  /  ...  /  build-mpi-operator-compatible-base
7m 16s
amd64 / test-nccl / build-mpi-operator-compatible-base
amd64  /  ...  /  build-nccl-gke
6m 45s
amd64 / test-nccl / nccl-test-gke / build-nccl-gke
arm64  /  ...  /  build-mpi-operator-compatible-base
arm64 / test-nccl / build-mpi-operator-compatible-base
arm64  /  ...  /  build-nccl-gke
arm64 / test-nccl / nccl-test-gke / build-nccl-gke
Matrix: amd64 / test-cutlass
Matrix: amd64 / test-jax
Matrix: amd64 / test-nsys-jax-nccl
Matrix: amd64 / test-te
amd64  /  build-torchax
0s
amd64 / build-torchax
amd64  /  build-maxtext
0s
amd64 / build-maxtext
amd64  /  build-alphafold
0s
amd64 / build-alphafold
amd64  /  build-axlearn
0s
amd64 / build-axlearn
Matrix: amd64 / test-nsys-jax-unit
amd64  /  build-equinox
0s
amd64 / build-equinox
Matrix: amd64 / test-nccl / nccl-test
Matrix: amd64 / test-nccl / nccl-test-gke / nccl-gke
Matrix: arm64 / test-cutlass
Matrix: arm64 / test-jax
Matrix: arm64 / test-nsys-jax-nccl
Matrix: arm64 / test-te
arm64  /  build-torchax
arm64 / build-torchax
arm64  /  build-maxtext
arm64 / build-maxtext
arm64  /  build-alphafold
arm64 / build-alphafold
arm64  /  build-axlearn
arm64 / build-axlearn
Matrix: arm64 / test-nsys-jax-unit
arm64  /  build-equinox
arm64 / build-equinox
Matrix: arm64 / test-nccl / nccl-test
Waiting for pending jobs
Matrix: arm64 / test-nccl / nccl-test-gke / nccl-gke
Waiting for pending jobs
Matrix: amd64 / test-maxtext-gke / maxtext-gke
Waiting for pending jobs
Matrix: amd64 / test-maxtext
amd64  /  test-alphafold-inference
0s
amd64 / test-alphafold-inference
amd64  /  test-axlearn-eks
0s
amd64 / test-axlearn-eks
amd64  /  test-axlearn-fuji-models-eks
0s
amd64 / test-axlearn-fuji-models-eks
Matrix: amd64 / test-nsys-jax-unit-archive
amd64  /  collect-docker-tags
3s
amd64 / collect-docker-tags
Matrix: arm64 / test-maxtext-gke / maxtext-gke
Waiting for pending jobs
Matrix: arm64 / test-maxtext
arm64  /  test-alphafold-inference
0s
arm64 / test-alphafold-inference
arm64  /  test-axlearn-eks
0s
arm64 / test-axlearn-eks
arm64  /  test-axlearn-fuji-models-eks
0s
arm64 / test-axlearn-fuji-models-eks
Matrix: arm64 / test-nsys-jax-unit-archive
arm64  /  collect-docker-tags
2s
arm64 / collect-docker-tags
make-publish-configs
5s
make-publish-configs
merge-new-manifest
13s
merge-new-manifest
Matrix: publish-containers
finalize  /  workflow-badge
7s
finalize / workflow-badge
finalize  /  report
9s
finalize / report
finalize  /  upload-badge
5s
finalize / upload-badge
finalize  /  publish-badge
9s
finalize / publish-badge
Fit to window
Zoom out
Zoom in

Annotations

8 errors and 13 warnings
arm64 / build-jax
buildx failed with: ERROR: failed to build: failed to solve: process "/bin/bash -c mkdir -p /builder/extra-targets/{bin,python} && build-jax.sh --bazel-cache ${BAZEL_CACHE} --build-path-jaxlib ${BUILD_PATH_JAXLIB} --extra-targets \"${EXTRA_BAZEL_TARGETS}\" --extra-target-dest /builder/extra-targets --no-install --src-path-jax ${SRC_PATH_JAX} --src-path-xla ${SRC_PATH_XLA} --clean ${EXTRA_BUILD_JAX_ARGS}" did not complete successfully: exit code: 1
amd64 / build-jax
buildx failed with: ERROR: failed to build: failed to solve: process "/bin/bash -c mkdir -p /builder/extra-targets/{bin,python} && build-jax.sh --bazel-cache ${BAZEL_CACHE} --build-path-jaxlib ${BUILD_PATH_JAXLIB} --extra-targets \"${EXTRA_BAZEL_TARGETS}\" --extra-target-dest /builder/extra-targets --no-install --src-path-jax ${SRC_PATH_JAX} --src-path-xla ${SRC_PATH_XLA} --clean ${EXTRA_BUILD_JAX_ARGS}" did not complete successfully: exit code: 1
amd64 / test-nccl / nccl-test (all_reduce_perf_mpi)
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
amd64 / test-nccl / nccl-test (all_gather_perf_mpi)
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
amd64 / test-nccl / nccl-test (reduce_scatter_perf_mpi)
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
amd64 / test-nccl / nccl-test (broadcast_perf_mpi)
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
CI
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
CI
Canceling since a higher priority waiting request for CI-refs/heads/main-amd64 exists
amd64 / build-base / build-base
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
arm64 / build-base / build-base
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
arm64 / build-jax
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: aws-actions/configure-aws-credentials@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
amd64 / build-jax
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: aws-actions/configure-aws-credentials@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
amd64 / test-nccl / nccl-test-gke / nccl-gke (reduce_scatter_perf_mpi)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/login-action@v3. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
amd64 / test-nccl / nccl-test-gke / nccl-gke (broadcast_perf_mpi)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/login-action@v3. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
amd64 / test-nccl / nccl-test-gke / nccl-gke (all_gather_perf_mpi)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/login-action@v3. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
amd64 / test-nccl / nccl-test-gke / nccl-gke (all_reduce_perf_mpi)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: docker/login-action@v3. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
merge-new-manifest
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: octokit/request-action@v2.x. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
merge-new-manifest
Unexpected input(s) 'owner_and_repo', valid inputs are ['route', 'mediaType']
merge-new-manifest
Unexpected input(s) 'owner_and_repo', 'head', 'base', 'body', 'title', 'draft', valid inputs are ['route', 'mediaType']
finalize / upload-badge
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@v7. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
finalize / publish-badge
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/github-script@v7. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
NVIDIA~JAX-Toolbox~1A3PMZ.dockerbuild
46.6 KB
sha256:a8ef57e579e49f619efa60a82dbe00ceab62cb2531347549a33a7f59dae101d7
NVIDIA~JAX-Toolbox~2QSHTD.dockerbuild
86.9 KB
sha256:0ef8fe77e111ea33ca0cc06713a0a093f071b5c33760440f494f0ef8c5955251
NVIDIA~JAX-Toolbox~5M70T8.dockerbuild
40.7 KB
sha256:2aebcc06e3b6a54fe68f99e270cd2cf5040b9b4769e6697e7642afd1ebbd9b8b
NVIDIA~JAX-Toolbox~8IUOUB.dockerbuild
87.2 KB
sha256:cef2b77e295f90306a1e07533bf4d38295097dc42c36283beb2753d80c4def1e
NVIDIA~JAX-Toolbox~B27HA2.dockerbuild
47.1 KB
sha256:cac0528de2e8ece41eae4b9d988420fdd2cce8819621d30fc442c02068de432b
NVIDIA~JAX-Toolbox~ICLH3K.dockerbuild
84.2 KB
sha256:7c049d6a88ab163907592a7a328463f4976328233503d2d733ce13447ddb65bf
NVIDIA~JAX-Toolbox~UBJNWQ.dockerbuild
69.9 KB
sha256:ca781a1a2aa5bcac0eb92fa7da9633f43042e6010de15b84637265b282e47314
NVIDIA~JAX-Toolbox~Z7F3HX.dockerbuild
46.6 KB
sha256:eaee3aa14aa56ac7b7c9ee53a4a37dbb988d28bcf057f68f9ffdd264adc83880
artifact-base-build-amd64
568 Bytes
sha256:155c4aedc9539fe0a4d317d0ec64e78bcc4a61fb3f3bf90951c9cdea9dcfeae1
artifact-base-build-arm64
566 Bytes
sha256:b437f98d7b6964a45e1f63a2e1f61a046669814e0946706dafd211fc9b01ea47
artifact-final-report
1.49 KB
sha256:685eafdee088de7e16a78890c29a6179154bb046585979f477052bd1f04bc0ea
artifact-jax-build-amd64
457 Bytes
sha256:79417087ea21852ecd7a2bf97cde550f581b186445bd8ba03424360fa6f9fbd3
artifact-jax-build-arm64
458 Bytes
sha256:12946863e3ab1305133b0770a677989ec0198df4e2980660aca1f646d029b1f6
artifact-mpi-operator-compatible-base-build-amd64
638 Bytes
sha256:f7b629a80487c12147daff68ce56b6b623700803da9b2f373edf3e44be53283d
artifact-nccl-gke-build-amd64
572 Bytes
sha256:449cc06d65313b15653ce607cb0b6387a155501d3f2f719538c235fcae8698bc
artifact-workflow-metadata
277 Bytes
sha256:01c497d1d370bc2294ba785867417008e0f05c0539115e133b5f5c05e7f2e4fa
bazel-remote-diagnostics-amd64
540 KB
sha256:b17be511eaefcaf8fafb2e934d082691a5a4910c8d3b9e48a23465852b62ba6e
bazel-remote-diagnostics-arm64
685 KB
sha256:41ea189ec6c2cdcd483eb1a1dd718643b9f332584cd1c4dd41342c2c983c5a77
bumped-manifest
5.85 KB
sha256:698483f5840b761449df848ea14fd2bfa6cdb4cadd595bbb245ec95c72f0ec98
final-base
250 Bytes
sha256:014abab5fcbb5e571027135d7b71fd786440e5ca2d30489a52647acd134579cb
nccl-gke-all-gather
10.3 KB
sha256:80e6c20f78b1efc3fa2742de38cb2e68313561d78b241619df89f2a6c2782ef4
nccl-gke-all-gather-H100
580 Bytes
sha256:343c810d6cb4e40a59b49a96f0e6b437fe6fb60ab4b53d8197274333f32e651b
nccl-gke-all-reduce
10.4 KB
sha256:b1719c0f3fc1254116b8b65e023b5c2bc6c4517d0b83f4f8a3e82c38faaa4bf4
nccl-gke-all-reduce-H100
581 Bytes
sha256:678eee0ef10145ec3e61d55b0b8cefe00621516db7f75e920aa8f889d5127a10
nccl-gke-broadcast
10.3 KB
sha256:3fc149806ce45d4560ce0d7ea917479fd18d6f08df89c8d862bcf7454d6db66d
nccl-gke-broadcast-H100
577 Bytes
sha256:4fdd1323767b9cf85552d956e2422f545a820f42d6a650ab30cccd3792721a5e
nccl-gke-reduce-scatter
10.4 KB
sha256:fa67e202069c6eff0c5772f0f799f8a39d7d0861a182610589608897dc171f3c
nccl-gke-reduce-scatter-H100
593 Bytes
sha256:03c9d6404b7fedefc671c1752cbd5b6e7fa57d39a3beabe5de4787db629ba73f
nsys-jax-version-file
384 Bytes
sha256:8edd95a028f9c34c1df514830ce6bceedd94ab07224caf38ef049fb5881fe444