Skip to content

docs(eval): document v4.42.4 eval migrations#1616

Merged
christso merged 4 commits into
mainfrom
fix/migration-skill-v4424-audit
Jul 3, 2026
Merged

docs(eval): document v4.42.4 eval migrations#1616
christso merged 4 commits into
mainfrom
fix/migration-skill-v4424-audit

Conversation

@christso

@christso christso commented Jul 3, 2026

Copy link
Copy Markdown
Collaborator

Summary

Workers migrating old eval YAML now have a version-specific map from AgentV v4.42.4 to the current authoring contract. The migration skill distinguishes actual breaking parser/schema changes from newer conventions, so stale evals are less likely to be rewritten into another invalid intermediate shape.

This PR also removes the workspace.repos[].base_commit authoring alias from current eval YAML: core schema/parser/validator, prepared workspace pins, CLI prepare output, the SDK authoring helper, generated eval schema, examples, importer output, and current docs now use workspace.repos[].commit only. Stale repo keys fall through generic unsupported-field handling rather than a named compatibility path.

The reference covers the audited v4.42.4 shapes for execution, assertions, criteria, repeat/trials, workspace mode/isolation, target labels, hook commands, imports, prompt file references, and repo provenance, with current equivalents and verification commands for each.

Related: Bead av-cdcv

Validation

  • bun test packages/core/test/evaluation/workspace/deps-scanner.test.ts packages/core/test/evaluation/validation/eval-validator.test.ts packages/core/test/evaluation/workspace-config-parsing.test.ts packages/core/test/evaluation/workspace/script-executor.test.ts
  • bun test packages/core/test/evaluation/repo-schema-validation.test.ts packages/core/test/evaluation/workspace-config-parsing.test.ts packages/core/test/evaluation/validation/eval-validator.test.ts packages/core/test/evaluation/workspace/deps-scanner.test.ts packages/core/test/evaluation/workspace/repo-manager.test.ts packages/core/test/evaluation/workspace/script-executor.test.ts packages/core/test/evaluation/validation/eval-schema-sync.test.ts
  • bun test packages/sdk
  • bun --filter agentv test
  • bun --filter @agentv/core build && bun --filter agentv build
  • bun run build
  • bun run typecheck
  • bun run validate:examples
  • bun --filter agentv build
  • bun apps/cli/src/cli.ts skills get agentv-eval-migrations --ref breaking-changes
  • temp eval validation confirms unsupported repo keys fail through generic unsupported-field guidance
  • git diff --check

Compound Engineering
Codex

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jul 3, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 7c4d534
Status: ✅  Deploy successful!
Preview URL: https://7a10a103.agentv.pages.dev
Branch Preview URL: https://fix-migration-skill-v4424-au.agentv.pages.dev

View logs

@christso christso force-pushed the fix/migration-skill-v4424-audit branch from 1bafa48 to 486ac93 Compare July 3, 2026 09:24
@christso christso force-pushed the fix/migration-skill-v4424-audit branch from 486ac93 to 7c4d534 Compare July 3, 2026 09:39
@christso christso marked this pull request as ready for review July 3, 2026 09:41
@christso christso merged commit a1186d8 into main Jul 3, 2026
8 checks passed
@christso christso deleted the fix/migration-skill-v4424-audit branch July 3, 2026 09:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant