docs: correct dead kvstats metric names in Grafana dashboards and doc… #289
- automated-release requires an approval to start deploying changes
saturley-hall- automated-release requires an approval to start deploying changes
release.yml
on: push
Prepare Release
3s
Approve Manual Run
0s
Matrix: sglang builds / pipeline
Matrix: trtllm builds / pipeline
Matrix: vllm builds / pipeline
Matrix: trtllm EFA builds / pipeline
Matrix: vllm EFA builds / pipeline
Clean K8s builder if exists
12s
Matrix: Build Frontend Images / Build Frontend Image
Matrix: deploy-test-sglang
Matrix: deploy-test-trtllm
Matrix: deploy-test-vllm
Build Frontend Images
/
Clean K8s builder if exists
12s
Cleanup AKS resources
33s
Tag RC & Publish to NGC
automated-release
waiting for review
Deployment protection rules
Reviewers, timers, and other rules protecting deployments in this run
| Event | Environments |
|---|---|
saturley-hall
requested review
|
automated-release |
Annotations
10 errors and 16 warnings
|
Build Frontend Images / Build EPP Image
Response status code does not indicate success: 401 (Unauthorized).
|
|
Build Frontend Images / frontend-status-check
Process completed with exit code 1.
|
|
trtllm builds / trtllm-cuda13.1-amd64 / Multi-gpu Test trtllm-cuda13.1-amd64
Process completed with exit code 1.
|
|
trtllm builds / trtllm-cuda13.1-amd64 / Test trtllm-cuda13.1-amd64
The action has timed out.
|
|
trtllm builds / trtllm-cuda13.1-amd64 / Test trtllm-cuda13.1-amd64
The action has timed out.
|
|
trtllm builds / trtllm-cuda13.1-amd64 / Test trtllm-cuda13.1-amd64
The action has timed out.
|
|
deploy-test-trtllm (agg)
Process completed with exit code 1.
|
|
deploy-test-trtllm (agg_router)
Process completed with exit code 1.
|
|
deploy-test-trtllm (disagg)
Process completed with exit code 1.
|
|
deploy-test-trtllm (disagg_router)
Process completed with exit code 1.
|
|
Build Frontend Images / Build EPP Image
Back off 25.257 seconds before retry.
|
|
Build Frontend Images / Build EPP Image
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/08eba0b27e820071cde6df949e0beb9ba4906955'. Error: Response status code does not indicate success: 401 (Unauthorized). A128:2FEC5D:610B1F:62B82E:69B2213C
|
|
Build Frontend Images / Build EPP Image
Back off 29.804 seconds before retry.
|
|
Build Frontend Images / Build EPP Image
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/08eba0b27e820071cde6df949e0beb9ba4906955'. Error: Response status code does not indicate success: 401 (Unauthorized). 9BF8:20E705:5FEE5E:619777:69B2211E
|
|
vllm builds / vllm-cuda13.0-amd64 / Build vllm-cuda13.0-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
vllm builds / vllm-cuda12.9-arm64 / Build vllm-cuda12.9-arm64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
sglang builds / sglang-cuda13.0-arm64 / Build sglang-cuda13.0-arm64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
sglang builds / sglang-cuda13.0-amd64 / Build sglang-cuda13.0-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
sglang builds / sglang-cuda12.9-amd64 / Build sglang-cuda12.9-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
sglang builds / sglang-cuda12.9-arm64 / Build sglang-cuda12.9-arm64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
trtllm builds / trtllm-cuda13.1-arm64 / Build trtllm-cuda13.1-arm64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
vllm EFA builds / vllm-cuda12.9-amd64 / Build vllm-cuda12.9-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
vllm builds / vllm-cuda13.0-arm64 / Build vllm-cuda13.0-arm64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
trtllm EFA builds / trtllm-cuda13.1-amd64 / Build trtllm-cuda13.1-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
trtllm builds / trtllm-cuda13.1-amd64 / Build trtllm-cuda13.1-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
|
vllm builds / vllm-cuda12.9-amd64 / Build vllm-cuda12.9-amd64
Unexpected input(s) 'ci_token', valid inputs are ['framework', 'target', 'platform', 'cuda_version', 'image_tag', 'aws_default_region', 'sccache_s3_bucket', 'aws_account_id', 'aws_access_key_id', 'aws_secret_access_key', 'no_cache', 'extra_tags', 'push_image', 'no_load', 'use_sccache', 'extra_build_args']
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
build-metrics-sglang-runtime-amd64-22983469387-66728273165
|
6.87 KB |
sha256:d4adca25e724427687f6dd9619e2af6efcbc40ff73d615214655100c8a672a9f
|
|
|
build-metrics-sglang-runtime-amd64-22983469387-66728273172
|
7.02 KB |
sha256:d60547dc67a40ada3865a4b611e2436a0efc50b8b904e164f8d8f714e40c3098
|
|
|
build-metrics-sglang-runtime-arm64-22983469387-66728273171
|
6.36 KB |
sha256:b3128d29128cbb0327449c58cf76259e5474af3ce8f7c1606c311c59c1a2d105
|
|
|
build-metrics-sglang-runtime-arm64-22983469387-66728273184
|
6.79 KB |
sha256:29f714871b74957930ac7fccadaa515afa76357cdfc2e5552200c4e1db4dba05
|
|
|
build-metrics-trtllm-runtime-amd64-22983469387-66728273154
|
8.86 KB |
sha256:e2a77d18607f8cfc282c81a6e6f6e59f8a13fb9d17db2731d4f37a107e9380f4
|
|
|
build-metrics-trtllm-runtime-amd64-22983469387-66728273180
|
10.8 KB |
sha256:a998403917a3721d79483409f9c1fc16d35184f9a6f7c8c646208afc8ae19db0
|
|
|
build-metrics-trtllm-runtime-arm64-22983469387-66728273158
|
10 KB |
sha256:3124ad6215a8353d24ab478547f33d479ab83eb016b228aa1e943b6a6f8d5953
|
|
|
build-metrics-vllm-runtime-amd64-22983469387-66728273207
|
7.95 KB |
sha256:10ce4911fa9f15f8b161e6a947a1d69eb178e0e8405988648f27594f943c1e64
|
|
|
build-metrics-vllm-runtime-amd64-22983469387-66728273220
|
8.97 KB |
sha256:8a55d71cc73c5bfb010b3b1427f1cbee17c048c8bb102b6b9b3396964df0277a
|
|
|
build-metrics-vllm-runtime-amd64-22983469387-66728273222
|
7.14 KB |
sha256:a6f14b2f34212183f4d772d1efc41fe78fc84801f65fa076374f201c2338be17
|
|
|
build-metrics-vllm-runtime-arm64-22983469387-66728273192
|
8.36 KB |
sha256:942668e8a0bf54150ef8a1ec23c6da7d0cd569d23bcdac9617fb2db2b9d8a625
|
|
|
build-metrics-vllm-runtime-arm64-22983469387-66728273227
|
4.11 KB |
sha256:8131913705adf7f2d84c07d52afa90399285fd98743411bfd717ea29534c2017
|
|
|
test-results-sglang-agg-amd64-22983469387-66735617413
|
492 Bytes |
sha256:b74e6f5dcca9787123190e5b0fdb4c8010aabe42ab958ee94722f49ccb5e2c43
|
|
|
test-results-sglang-agg_router-amd64-22983469387-66735617417
|
507 Bytes |
sha256:c3104860e8f5fd371246f16e908272beb765492c77bdd8da6cda0c7b3ebf2830
|
|
|
test-results-sglang-pre_merge_cpu-amd64-22983469387-66728646166
|
1.03 KB |
sha256:55bb0fda00227032a6e4a0315b383c24549268c658c214fbc9d6c71a31d3e938
|
|
|
test-results-sglang-pre_merge_cpu-amd64-22983469387-66728651475
|
1.03 KB |
sha256:b8fa6030a8432f58720d237b66564e05e40725635863796c877fbdccb6f6662b
|
|
|
test-results-sglang-pre_merge_cpu-arm64-22983469387-66728540408
|
1.04 KB |
sha256:5b9ae4be218c5deb4b72f7dffb1bd54ae659b5e932aa37ab472550430434b7ff
|
|
|
test-results-sglang-pre_merge_cpu-arm64-22983469387-66728679861
|
1.04 KB |
sha256:5ff76c87179d7a1912b8c467ff511755d9a838a152a48fb90ab8ee874ea12839
|
|
|
test-results-sglang-pre_merge_gpu-amd64-22983469387-66728646140
|
722 Bytes |
sha256:24431a893d8eb11b66dbf34cb0fc46bfe63aa8a248eb75f3e3ae676eec5aedde
|
|
|
test-results-sglang-pre_merge_gpu-amd64-22983469387-66728646166
|
2.12 KB |
sha256:e0707bfb911ac0248f93ea029017c32cdecb8772e8d222b1c7231443fc718f52
|
|
|
test-results-sglang-pre_merge_gpu-amd64-22983469387-66728651468
|
720 Bytes |
sha256:5f20acb7925d36cdf6079b8fe792e57a7da00c76bcfcf155120dc9aed6e0449e
|
|
|
test-results-sglang-pre_merge_gpu-amd64-22983469387-66728651475
|
2.12 KB |
sha256:ab512986005230d35d80664aa7c94c1354f5fff2b5f9b0fafab6cdabaa30a5d1
|
|
|
test-results-trtllm-agg-amd64-22983469387-66735617422
|
1.94 KB |
sha256:4f0b0011c834946e8c5c0512e06fffc47c9cf3c9212ee7c70636817c0b7bc8ca
|
|
|
test-results-trtllm-agg_router-amd64-22983469387-66735617438
|
1.94 KB |
sha256:0dccdbf586a0e0f7d1704e0f9c9472a865cd792d0bfe2bb42559e8bf9ae0e6e1
|
|
|
test-results-trtllm-disagg-amd64-22983469387-66735617434
|
1.93 KB |
sha256:e7081c707dee87cc63e28c62be4845b26203e4f810c79cd00d19de42cce67741
|
|
|
test-results-trtllm-disagg_router-amd64-22983469387-66735617410
|
1.95 KB |
sha256:0759b2fab1e63c09e100819b0bbb489cbb474876e58758760ea1a473c087a3c4
|
|
|
test-results-trtllm-pre_merge_cpu-amd64-22983469387-66729081170
|
1.82 KB |
sha256:757cd7f299d9147cda46d060157499f0646efc17d314c48b310660a3793ca9c8
|
|
|
test-results-trtllm-pre_merge_cpu-amd64-22983469387-66729083895
|
1.83 KB |
sha256:11f35e4a909863afe319d45cab9a4641d460e09ba74630594a84cdfaf99caff4
|
|
|
test-results-trtllm-pre_merge_cpu-arm64-22983469387-66728718343
|
1.55 KB |
sha256:b37394de99fbb5ec7abc06809e5240c2c05a18251f5132267f96da8a837ba4e4
|
|
|
test-results-trtllm-pre_merge_gpu-amd64-22983469387-66729081155
|
769 Bytes |
sha256:4e1ebbf39cc9f25d0d4d50a18e1bea31793fd57be91d73549f83be717735e1da
|
|
|
test-results-vllm-agg-amd64-22983469387-66735617424
|
487 Bytes |
sha256:6421dc1afe304bcb51ed702898a1c3b947eb281462636e4d1df9d1ed5a89e8c9
|
|
|
test-results-vllm-agg_router-amd64-22983469387-66735617425
|
504 Bytes |
sha256:4270b79bd3a9a0dc47de124295205d5f45cb49a287d82392769371e4852c0ce3
|
|
|
test-results-vllm-disagg-amd64-22983469387-66735617451
|
493 Bytes |
sha256:70f780afe356903161a5eaba01e20cde1fc538917117e032107de2946231ece1
|
|
|
test-results-vllm-disagg_router-amd64-22983469387-66735617452
|
511 Bytes |
sha256:26a24bce8c084c7c2bb08f56aedc64f08262b417af6a18a87e4fd9a2980253c4
|
|
|
test-results-vllm-pre_merge_cpu-amd64-22983469387-66728475950
|
3.04 KB |
sha256:d174c8c56e4fd0af415c67e062964939cf9df97a9860f68a8be15481d01565bb
|
|
|
test-results-vllm-pre_merge_cpu-amd64-22983469387-66728857628
|
3.03 KB |
sha256:f0a645c2b967a65c1463f2e9b062cff0b2db29b8daae9ce8360113110568897f
|
|
|
test-results-vllm-pre_merge_cpu-amd64-22983469387-66729293723
|
3.01 KB |
sha256:85de965bf1ee07e7407e3dbcb89573bbb1d1fa022b64d26b310df601f9a16b0c
|
|
|
test-results-vllm-pre_merge_cpu-arm64-22983469387-66728527873
|
2.9 KB |
sha256:b791793452960944ca4c94bf37df9589bbebd3d877b4db37cbeeebe819473904
|
|
|
test-results-vllm-pre_merge_cpu-arm64-22983469387-66728910946
|
2.88 KB |
sha256:93ef4cec0263c2700e90ddf190f171155543c66772d021ab8bcc315b5d611440
|
|
|
test-results-vllm-pre_merge_gpu-amd64-22983469387-66728475909
|
712 Bytes |
sha256:a919a1a94a117ebeb184754ecd4d188badd8610737ec16759b40b1486cc5ac5c
|
|
|
test-results-vllm-pre_merge_gpu-amd64-22983469387-66728475950
|
2.89 KB |
sha256:faea48e1f217a966243e25038a8f8e533a917ae62bf0e31a03e6ec2033a6e73f
|
|
|
test-results-vllm-pre_merge_gpu-amd64-22983469387-66729293723
|
2.87 KB |
sha256:4424ed796c1f3abcd76f8d880b15a434395bafbb6991d1904090f739b4a570b3
|
|
|
test-results-vllm-pre_merge_gpu-amd64-22983469387-66729293745
|
711 Bytes |
sha256:17a70779f7038f0547b46c3fbb55ae71c7f3915d363e258873296f8037cc4871
|
|