Skip to content

Run Kubernetes Agent Benchmark #25

Run Kubernetes Agent Benchmark

Run Kubernetes Agent Benchmark #25

Manually triggered May 28, 2025 22:31
Status Failure
Total duration 21m 31s
Artifacts 24

run-agent-framework-test.yaml

on: workflow_dispatch
Matrix: solve-challenge
summarize-results
2s
summarize-results
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 24 warnings
scenario1/deployment-pod-affinity-wrong-key.yaml
Process completed with exit code 1.
scenario1/secret-not-mounted.yaml
Process completed with exit code 1.
scenario1/deployment-env-mismatch.yaml
Process completed with exit code 1.
scenario1/deployment-impossible-pod-affinity.yaml
Process completed with exit code 1.
scenario1/deployment-low-resources.yaml
Process completed with exit code 1.
scenario1/configmap-readonly.yaml
Process completed with exit code 2.
scenario1/pod-hostport-conflict.yaml
Process completed with exit code 3.
scenario1/serviceaccount-misspelled.yaml
Process completed with exit code 2.
scenario1/configmap-missing-key.yaml
Process completed with exit code 2.
scenario1/configmap-misspelled.yaml
Process completed with exit code 2.
scenario1/pvc-wrong-storageclass.yaml
Process completed with exit code 3.
scenario1/deployment-scaled-down.yaml
Process completed with exit code 3.
scenario1/deployment-probe-failures.yaml
Process completed with exit code 1.
scenario1/pvc-wrong-accessmode.yaml
Process completed with exit code 3.
scenario1/pod-resource-quota-exceeded.yaml
The action 'Validate cluster fixed' has timed out after 1 minutes.
scenario1/network-policy.yaml
The action 'Run Test' has timed out after 6 minutes.
scenario1/pod-limit-range-exceeded.yaml
Process completed with exit code 2.
scenario1/secret-missing.yaml
Process completed with exit code 2.
scenario1/pod-security-context-issue.yaml
Process completed with exit code 2.
scenario1/deployment-pod-affinity-wrong-key.yaml
Skip output 'scn1_ch7' since it may contain secret.
scenario1/secret-not-mounted.yaml
Skip output 'scn1_ch14' since it may contain secret.
scenario1/deployment-env-mismatch.yaml
Skip output 'scn1_ch4' since it may contain secret.
scenario1/deployment-impossible-pod-affinity.yaml
Skip output 'scn1_ch5' since it may contain secret.
scenario1/deployment-low-resources.yaml
Skip output 'scn1_ch6' since it may contain secret.
scenario1/configmap-readonly.yaml
Skip output 'scn1_ch3' since it may contain secret.
scenario1/service-dns-resolution-fail.yaml
Skip output 'scn1_ch21' since it may contain secret.
scenario1/pod-hostport-conflict.yaml
Skip output 'scn1_ch18' since it may contain secret.
scenario1/serviceaccount-misspelled.yaml
Skip output 'scn1_ch16' since it may contain secret.
scenario1/configmap-missing-key.yaml
Skip output 'scn1_ch1' since it may contain secret.
scenario1/missing-service-selector.yaml
Skip output 'scn1_ch23' since it may contain secret.
scenario1/configmap-misspelled.yaml
Skip output 'scn1_ch2' since it may contain secret.
scenario1/service-no-endpoint.yaml
Skip output 'scn1_ch15' since it may contain secret.
scenario1/pvc-wrong-storageclass.yaml
Skip output 'scn1_ch12' since it may contain secret.
scenario1/service-incorrect-port-number.yaml
Skip output 'scn1_ch22' since it may contain secret.
scenario1/deployment-scaled-down.yaml
Skip output 'scn1_ch9' since it may contain secret.
scenario1/deployment-probe-failures.yaml
Skip output 'scn1_ch8' since it may contain secret.
scenario1/pvc-wrong-accessmode.yaml
Skip output 'scn1_ch11' since it may contain secret.
scenario1/pod-resource-quota-exceeded.yaml
Skip output 'scn1_ch20' since it may contain secret.
scenario1/network-policy.yaml
Skip output 'scn1_ch10' since it may contain secret.
scenario1/serviceaccount-permissions.yaml
Skip output 'scn1_ch17' since it may contain secret.
scenario1/pod-limit-range-exceeded.yaml
Skip output 'scn1_ch19' since it may contain secret.
scenario1/secret-missing.yaml
Skip output 'scn1_ch13' since it may contain secret.
scenario1/pod-security-context-issue.yaml
Skip output 'scn1_ch24' since it may contain secret.

Artifacts

Produced during runtime
Name Size Digest
scenario1-scn1_ch1-results Expired
6.16 KB
sha256:d63d38a69229c3ceeb81a4a43be11bdcf361d719820e190a5dfa1951285abedc
scenario1-scn1_ch10-results Expired
7.73 KB
sha256:aa1960bd4ee272ab41a85af7eedeef87a27c1b96f1d3a176827904bc35e68f64
scenario1-scn1_ch11-results Expired
7.77 KB
sha256:709b0b13366b2fb329ff2070026c449960e1e649aecd7d5cc013c2fa1eb9fbb1
scenario1-scn1_ch12-results Expired
7.87 KB
sha256:6a6ec6a2171ed5a6b7855db2c3dff235f6c15ed1308ca3d9bc5db63ba2c30336
scenario1-scn1_ch13-results Expired
1.14 KB
sha256:e740361c47e89df3973da5fc7a0d0f208943ebbc8e9d45f98841e20060005cf6
scenario1-scn1_ch14-results Expired
943 Bytes
sha256:87a3e2a576e28549d38b3e7dac25882b89d3dfd92fc002f795f3cc743f87c749
scenario1-scn1_ch15-results Expired
11.9 KB
sha256:457b160bc5da7236bb593ccc8393bc7e259b3953562b1012fcb0de54ea2da0fc
scenario1-scn1_ch16-results Expired
6.54 KB
sha256:b48184c8cbc65a3e75cc81f784be1585749d92496bd00b8c0cd052b25fed04bd
scenario1-scn1_ch17-results Expired
7.23 KB
sha256:a2e576a4d4653cc65433da5edd588d61e6f41eab72bd71ba610a43bd2ad6605c
scenario1-scn1_ch18-results Expired
4.94 KB
sha256:261e583d5c5085c5959e5cbc7bcfd553229049732006442357cc7a5a7cf233e9
scenario1-scn1_ch19-results Expired
1.3 KB
sha256:ff24020ee2409321a639c1921fabacbbe9d35c73eaaf368884a59e1ad3151248
scenario1-scn1_ch2-results Expired
4.79 KB
sha256:05bc7a79e3fdb8fcc97e426ff25fd8d1c4f1f15e1eadb07c18adb7365c641766
scenario1-scn1_ch20-results Expired
3.21 KB
sha256:88e9ff6786519a8dddd05eb69f9bd0c6e4f19a44205d40077db40a09ab7538b5
scenario1-scn1_ch21-results Expired
12.4 KB
sha256:3f0aae08d075dc247b94bc28c896405c08c6256f831f72d17ac71c56be38f8d2
scenario1-scn1_ch22-results Expired
9.2 KB
sha256:9cdf0ae7e409a36d5bd6e96b3919abd7305930964283a4f349e343bed92a2ce8
scenario1-scn1_ch23-results Expired
6.38 KB
sha256:e3c436fe0d8f5d7da5e663159096510e099e9eb033ef0b77ddb6aaccaaf670ac
scenario1-scn1_ch24-results Expired
7.12 KB
sha256:d3cc57110ebcacd03cf9fd90dd2b34c22b617bf0074ab082c155ddc75fb2346d
scenario1-scn1_ch3-results Expired
1.62 KB
sha256:b77400931c0639a4ada00ff903c9478aee9b1188603647414a28de31153bf191
scenario1-scn1_ch4-results Expired
999 Bytes
sha256:7f8ee973872a15a10644a1db71c16ff05b6945870e2793518706ebfcac4deeeb
scenario1-scn1_ch5-results Expired
7.15 KB
sha256:13d5eec825354b41a4e0c04f1db372ab68ae9fa8450eceaf9b726173487ae516
scenario1-scn1_ch6-results Expired
1.02 KB
sha256:09e7faf3bcc4a20810606843b8f8956faac7ad3c173d0c2bed44b6ab1358767c
scenario1-scn1_ch7-results Expired
978 Bytes
sha256:f708f9e9b7c41af87cc2178f9a240fb17a13dd29048f1c7457cac5b2f18a9500
scenario1-scn1_ch8-results Expired
7.66 KB
sha256:1308792111e7406b8ab669b873a50e39f87b0e670d2ba1293c1b3665c9a0da74
scenario1-scn1_ch9-results Expired
10.5 KB
sha256:bf83a4ccf624bd693db7467ac66ec9afff9e353a776642042a16408fc228451c