Fix severity classification and agent scope from RI CCAP lessons#106
Merged
hua7450 merged 1 commit intoPolicyEngine:mainfrom Mar 5, 2026
Merged
Fix severity classification and agent scope from RI CCAP lessons#106hua7450 merged 1 commit intoPolicyEngine:mainfrom
hua7450 merged 1 commit intoPolicyEngine:mainfrom
Conversation
…lessons Key changes: - Elevate wrong section citations to CRITICAL in reference-validator and consolidator - Add citation verification against PDF text in consolidator (encode-policy-v2) - Require reference-checker to verify replacement citations against source text - Add empty directory cleanup to implementation-validator cross-reference check - Add Historical Notes section to reporter PR description template - Add "Above X%" bracket boundary pattern (0.0001 shift) to parameter-patterns skill - Add bracket boundary consistency rule to edge-case-generator - Add "don't exhaustively test lookup tables" to testing-patterns skill, test-creator, edge-case-generator - Elevate hard-coded values (except 0, 1, 2) to CRITICAL in implementation-validator report - Add enum-with-numeric-ranges must-have-formula pattern to variable-patterns skill - Add existing variable discovery step to consolidator (encode-policy-v2) - Add explicit scope boundary to parameter-architect (parameters ONLY) - Add orchestrator rule to always spawn rules-engineer and test-creator - Elevate untested formula variables to CRITICAL in consolidator - Add non-functional tests (error margin >= 1 on booleans) to CRITICAL - Replace blanket error margin guidance with type-specific rules Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Fixes multiple pipeline issues discovered during the RI CCAP implementation session where correct findings were under-classified and agents exceeded their scope.
Root Causes Addressed
1. Severity classification gaps
The review pipeline correctly identified issues but classified them below CRITICAL, so the fix round skipped them:
4.3.1(B)→4.3.1(A)(4)) classified as mediumabsolute_error_margin: 1on booleans) classified as minor2. Agent scope violations
3. Missing verification steps
childcare_hours_per_week)Changes (10 files, 175 insertions)
Skills (shared knowledge — all agents inherit)
Agents
Commands
🤖 Generated with Claude Code