Skip to content

v1.33.3.0 fix: sanitize lone Unicode surrogates to prevent JSON serialization errors #1404

v1.33.3.0 fix: sanitize lone Unicode surrogates to prevent JSON serialization errors

v1.33.3.0 fix: sanitize lone Unicode surrogates to prevent JSON serialization errors #1404

Triggered via pull request May 13, 2026 05:00
Status Failure
Total duration 2m 55s
Artifacts 10

evals.yml

on: pull_request
build-image
16s
build-image
Matrix: evals
Fit to window
Zoom out
Zoom in

Annotations

23 errors and 16 warnings
evals (e2e-qa-workflow, test/skill-e2e-qa-workflow.test.ts)
Process completed with exit code 1.
error: expect(received).toContain(expected): test/skill-e2e-qa-workflow.test.ts#L70
Expected to contain: "error_api" Received: [ "success", "error_max_turns" ] at <anonymous> (/__w/gstack/gstack/test/skill-e2e-qa-workflow.test.ts:70:44)
error: expect(received).toContain(expected): test/skill-e2e-qa-workflow.test.ts#L70
Expected to contain: "error_api" Received: [ "success", "error_max_turns" ] at <anonymous> (/__w/gstack/gstack/test/skill-e2e-qa-workflow.test.ts:70:44)
error: expect(received).toContain(expected): test/skill-e2e-qa-workflow.test.ts#L70
Expected to contain: "error_api" Received: [ "success", "error_max_turns" ] at <anonymous> (/__w/gstack/gstack/test/skill-e2e-qa-workflow.test.ts:70:44)
evals (llm-judge, test/skill-llm-eval.test.ts)
Process completed with exit code 1.
error: Could not resolve authentication method. Expected either apiKey or authToken to be set. Or for one of the "X-Api-Key" or "Authorization" headers to be explicitly omitted: node_modules/@anthropic-ai/sdk/client.mjs#L114
at validateHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:114:19) at buildHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:481:14) at async buildRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:443:39) at async makeRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:221:50)
error: Could not resolve authentication method. Expected either apiKey or authToken to be set. Or for one of the "X-Api-Key" or "Authorization" headers to be explicitly omitted: node_modules/@anthropic-ai/sdk/client.mjs#L114
at validateHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:114:19) at buildHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:481:14) at async buildRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:443:39) at async makeRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:221:50)
error: Could not resolve authentication method. Expected either apiKey or authToken to be set. Or for one of the "X-Api-Key" or "Authorization" headers to be explicitly omitted: node_modules/@anthropic-ai/sdk/client.mjs#L114
at validateHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:114:19) at buildHeaders (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:481:14) at async buildRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:443:39) at async makeRequest (/__w/gstack/gstack/node_modules/@anthropic-ai/sdk/client.mjs:221:50)
evals (e2e-deploy, test/skill-e2e-deploy.test.ts)
Process completed with exit code 1.
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L358
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:358:31)
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L358
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:358:31)
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L358
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:358:31)
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L295
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:295:31)
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L295
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:295:31)
error: expect(received).toBe(expected): test/skill-e2e-deploy.test.ts#L295
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-deploy.test.ts:295:31)
evals (e2e-browse, test/skill-e2e-bws.test.ts, ubicloud-standard-8)
Process completed with exit code 1.
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L58
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:58:31)
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L83
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:83:31)
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L58
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:58:31)
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L83
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:83:31)
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L58
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:58:31)
error: expect(received).toBe(expected): test/skill-e2e-bws.test.ts#L83
Expected: "success" Received: "error_api" at <anonymous> (/__w/gstack/gstack/test/skill-e2e-bws.test.ts:83:31)
report
Process completed with exit code 1.
build-image
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, docker/login-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-workflow, test/skill-e2e-workflow.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-plan, test/skill-e2e-plan.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-qa-workflow, test/skill-e2e-qa-workflow.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (llm-judge, test/skill-llm-eval.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-qa-bugs, test/skill-e2e-qa-bugs.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-design, test/skill-e2e-design.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-codex, test/codex-e2e.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-codex, test/codex-e2e.test.ts)
No files were found with the provided path: ~/.gstack-dev/evals/*.json. No artifacts will be uploaded.
evals (e2e-deploy, test/skill-e2e-deploy.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-gemini, test/gemini-e2e.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-gemini, test/gemini-e2e.test.ts)
No files were found with the provided path: ~/.gstack-dev/evals/*.json. No artifacts will be uploaded.
evals (e2e-browse, test/skill-e2e-bws.test.ts, ubicloud-standard-8)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-review, test/skill-e2e-review.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (e2e-routing, test/skill-routing-e2e.test.ts)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
report
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
eval-e2e-browse Expired
5.6 KB
sha256:6b4f99141c4c598e6b74d753fbf146d233007730ddb3ec79fc5efe6bcbdefd1e
eval-e2e-deploy Expired
5.63 KB
sha256:bfb3d415fb8ed994f43225941d834f6add4ca3876259db1dc4dcf77d7f84f235
eval-e2e-design Expired
409 Bytes
sha256:f4cb18afcacbc112521da8b3aa9da2f20654b50ebe0e2c5d88b3670b3bf1461a
eval-e2e-plan Expired
402 Bytes
sha256:bb84ac3cfc936e988e1dfa4d5813a3ad9bef1a8e342d6202811d43449975ee5f
eval-e2e-qa-bugs Expired
411 Bytes
sha256:c7eaa2e4073270ec5b38551d9ea66175535c37a965ffd98d8b143285c532ed3c
eval-e2e-qa-workflow Expired
4.34 KB
sha256:8af9413f47353a4ae9eec1139201b5c4fa5059cda122101a254fc4a5a3133023
eval-e2e-review Expired
407 Bytes
sha256:8931f79a1ce79a1cf694176cea4ae473070447a936ad2a9bc452d05c52af989d
eval-e2e-routing Expired
410 Bytes
sha256:9f4fe127816bf4ce0ba7371672a4b683b14d0c61331be802a00264ffcdffb4c6
eval-e2e-workflow Expired
412 Bytes
sha256:442dc7ed08df9c2cf4d03c9c53716a8d6791533bdd086f6155d8f395ff25de44
eval-llm-judge Expired
407 Bytes
sha256:9c7988eaf5e4b5a2e6113b2150e56fc197199b77d7da8477b2e191b19aa4fb1e