Skip to content

Commit 316c5fc

Browse files
rysweetUbuntu
andauthored
fix: Add granular sub-steps and verification gates to Steps 16-18 (#2231)
* fix: Add granular sub-steps and verification gates to Steps 16-18 Implements solution for issue #2224 (completion bias after PR creation). Combines Option 2 (granular agent invocation todos) and Option 3 (explicit verification gates) to prevent agents from rushing through review steps after PR creation. Changes: - Step 16: Split into 5 sub-steps (16a-16e) with verification gate - 16a: Step 13 compliance verification - 16b: Invoke reviewer agent - 16c: Invoke security agent - 16d: Invoke philosophy-guardian agent - 16e: Address blocking issues - Step 17: Split into 4 sub-steps (17a-17d) with verification gate - 17a: Review all feedback - 17b: Address feedback with builder agent - 17c: Push and respond - 17d: Verify and re-review if needed - Step 18: Split into 3 sub-steps (18a-18c) with verification gate - 18a: Invoke reviewer agent for philosophy check - 18b: Invoke patterns agent - 18c: Zero-BS verification Each step now requires explicit evidence of completion before the verification gate allows proceeding to the next step. Fixes #2224 * fix: Align sub-step numbering between markdown and YAML Address reviewer feedback: - Add Step 16a (Step 13 compliance verification) to YAML - Add Step 16e (address blocking issues) to YAML - Rename verification gates to explicit sub-step labels (16f, 17e, 18d) - Add missing context variables (pr_security_review, pr_philosophy_review, blocking_issues_addressed) - Update Step 0 to reflect correct sub-step counts Both .md and .yaml now have consistent sub-step structure: - Step 16: 16a-16f (6 sub-steps) - Step 17: 17a-17e (5 sub-steps) - Step 18: 18a-18d (4 sub-steps) --------- Co-authored-by: Ubuntu <azureuser@amplihack-dev.ftnmxvem3frujn3lepas045p5c.xx.internal.cloudapp.net>
1 parent 40056bc commit 316c5fc

File tree

3 files changed

+596
-104
lines changed

3 files changed

+596
-104
lines changed

.claude/workflow/DEFAULT_WORKFLOW.md

Lines changed: 116 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -572,20 +572,58 @@ python .claude/scenarios/az-devops-tools/create_pr.py \
572572
- Quality gates exist for a reason - bypassing them introduces risk
573573
- Pattern of skipping reviews leads to technical debt accumulation
574574

575-
**Review checklist:**
575+
**Step 16a: Step 13 Compliance Verification**
576+
577+
- [ ] Check PR description has "Step 13: Local Testing Results" section with actual test execution evidence
578+
- [ ] If missing: BLOCK review, comment on PR, request test results (no approval path - just do the testing)
579+
580+
**Step 16b: Invoke reviewer agent**
576581

577-
- [ ] **⚠️ Step 13 Compliance Verification (MANDATORY)** - Verify PR description contains test results
578-
- [ ] Check PR description has "Step 13: Local Testing Results" section with actual test execution evidence
579-
- [ ] If missing: BLOCK review, comment on PR, request test results (no approval path - just do the testing)
580582
- [ ] **Always use** reviewer agent for comprehensive code review
581583
- **Alternative**: Use `/socratic-review` for dialogue-based review when learning is as important as fixing (mentoring, design documentation, complex code explanation)
582-
- [ ] **Use** security agent for security review
583584
- [ ] Check code quality and standards
584-
- [ ] Verify philosophy compliance
585585
- [ ] Ensure adequate test coverage
586586
- [ ] Identify potential improvements
587-
- [ ] Ensure there are no TODOs, stubs, or swallowed exceptions, no unimplemented functions - follow the zero-BS principle.
588-
- [ ] Post the review as a comment on the PR:
587+
- [ ] Ensure there are no TODOs, stubs, or swallowed exceptions, no unimplemented functions - follow the zero-BS principle
588+
- [ ] **POST structured review findings to the PR** → Evidence: review comment link
589+
590+
**Step 16c: Invoke security agent**
591+
592+
- [ ] **Use** security agent for security review
593+
- [ ] Verify no security vulnerabilities introduced
594+
- [ ] Check authentication/authorization if applicable
595+
- [ ] Verify sensitive data handling
596+
- [ ] **POST security review to the PR** → Evidence: security comment link
597+
598+
**Step 16d: Invoke philosophy-guardian agent**
599+
600+
- [ ] **Use** philosophy-guardian agent to verify philosophy compliance
601+
- [ ] Verify ruthless simplicity achieved
602+
- [ ] Confirm bricks & studs pattern followed
603+
- [ ] Ensure zero-BS implementation
604+
- [ ] **POST philosophy check to the PR** → Evidence: philosophy comment link
605+
606+
**Step 16e: Address blocking issues**
607+
608+
- [ ] Review all findings from 16b, 16c, 16d
609+
- [ ] Address any blocking issues found before proceeding
610+
- [ ] If issues found, fix and re-run applicable reviews
611+
612+
**Step 16f: Verification Gate**
613+
614+
**🚨 VERIFICATION GATE - Before marking Step 16 complete, verify:**
615+
616+
- [ ] Did I invoke the **reviewer** agent (not just code-review)?
617+
- [ ] Did I invoke the **security** agent?
618+
- [ ] Did I invoke the **philosophy-guardian** agent?
619+
- [ ] Are all three reviews **posted to the PR** as comments?
620+
- [ ] All blocking issues have been addressed?
621+
622+
**Cannot proceed to Step 17 without completing this gate.**
623+
624+
---
625+
626+
\*\*Post reviews as comments on the PR:
589627

590628
**For GitHub**:
591629

@@ -611,13 +649,46 @@ az repos pr create-thread \
611649
- Indicates disrespect for reviewer's time and expertise
612650
- May block PR merge indefinitely
613651

614-
**Feedback implementation checklist:**
652+
**Step 17a: Review all feedback**
653+
654+
- [ ] Gather all feedback comments from Step 16 reviews (reviewer, security, philosophy-guardian)
655+
- [ ] Think very carefully about each comment
656+
- [ ] Categorize: blocking issues vs. suggestions vs. questions
657+
658+
**Step 17b: Address feedback with builder agent**
615659

616-
- [ ] Review all feedback comments, think very carefully about each one and decide how to address it (or if you should disagree, explain why in a comment)
617660
- [ ] **Always use** builder agent to implement changes
618-
- [ ] **Use** relevant specialized agents for specific feedback
619-
- [ ] Address each review comment
661+
- [ ] **Use** relevant specialized agents for specific feedback types
662+
- [ ] Address each review comment substantively
663+
- [ ] For disagreements, explain reasoning in a PR comment
664+
665+
**Step 17c: Push and respond**
666+
620667
- [ ] Push updates to PR
668+
- [ ] Respond to each review comment with what was done
669+
- [ ] Post replies as comments on the PR
670+
671+
**Step 17d: Verify and re-review if needed**
672+
673+
- [ ] Ensure all tests still pass
674+
- [ ] Ensure PR is still mergeable
675+
- [ ] Request re-review if significant changes were made
676+
677+
**Step 17e: Verification Gate**
678+
679+
**🚨 VERIFICATION GATE - Before marking Step 17 complete, verify:**
680+
681+
- [ ] Did I address EVERY feedback comment (not just some)?
682+
- [ ] Did I respond to each comment on the PR explaining what was done?
683+
- [ ] Did I use the builder agent for implementation changes?
684+
- [ ] Are all tests still passing?
685+
686+
**Cannot proceed to Step 18 without completing this gate.**
687+
688+
---
689+
690+
**Feedback implementation checklist:**
691+
621692
- [ ] Respond to review comments by posting replies as comments on the PR:
622693

623694
**For GitHub**:
@@ -640,14 +711,46 @@ az repos pr create-thread \
640711

641712
### Step 18: Philosophy Compliance Check
642713

714+
**Step 18a: Invoke reviewer agent for philosophy check**
715+
643716
- [ ] **Always use** reviewer agent for final philosophy check
717+
- [ ] Verify implementation aligns with project philosophy
718+
- [ ] Check for over-engineering or unnecessary complexity
719+
- [ ] **Document findings** → Evidence: philosophy review notes
720+
721+
**Step 18b: Invoke patterns agent**
722+
644723
- [ ] **Use** patterns agent to verify pattern compliance
724+
- [ ] Design patterns used correctly
725+
- [ ] Architectural patterns followed
726+
- [ ] Code organization patterns maintained
727+
- [ ] **Document findings** → Evidence: patterns review notes
728+
729+
**Step 18c: Zero-BS verification**
730+
645731
- [ ] Verify ruthless simplicity achieved
646732
- [ ] Confirm bricks & studs pattern followed
647-
- [ ] Ensure zero-BS implementation (no stubs, faked apis, swallowed exceptions, etc)
733+
- [ ] Ensure zero-BS implementation:
734+
- No stubs
735+
- No faked APIs or data
736+
- No swallowed exceptions
737+
- No TODO comments
738+
- No unimplemented functions
648739
- [ ] Verify all tests passing
649740
- [ ] Check documentation completeness and accuracy
650741

742+
**Step 18d: Verification Gate**
743+
744+
**🚨 VERIFICATION GATE - Before marking Step 18 complete, verify:**
745+
746+
- [ ] Did I invoke the **reviewer** agent for philosophy check?
747+
- [ ] Did I invoke the **patterns** agent?
748+
- [ ] Did I complete the zero-BS verification checklist?
749+
- [ ] Are all findings documented?
750+
- [ ] Any issues found have been addressed?
751+
752+
**Cannot proceed to Step 19 without completing this gate.**
753+
651754
### Step 19: Outside-In Testing in Real Environment
652755

653756
**🚨 VERIFICATION GATE - CANNOT PROCEED WITHOUT:**

0 commit comments

Comments
 (0)