Skip to content

docs: comprehensive documentation review and remediation#113

Open
scottschreckengaust wants to merge 4 commits intomainfrom
docs/comprehensive-documentation-review-remediation
Open

docs: comprehensive documentation review and remediation#113
scottschreckengaust wants to merge 4 commits intomainfrom
docs/comprehensive-documentation-review-remediation

Conversation

@scottschreckengaust
Copy link
Member

@scottschreckengaust scottschreckengaust commented Mar 12, 2026

Summary

Comprehensive documentation review and remediation addressing ~33 issues identified across the entire AI-DLC repository. Changes span 19 files covering rule detail files, core workflow, README, CI/CD configs, and extensions.

  • Fix critical bugs: duplicate headings, broken cross-references, incorrect step references
  • Standardize terminology: "phase" vs "stage", deprecated stage names, Code Planning merger
  • Replace stale overconfidence "skip" directives with proactive evaluation patterns
  • Fix README: add PowerShell instructions, ToC entries, directory diagrams, troubleshooting
  • Standardize formatting: ASCII diagram compliance, completion message templates
  • Fix CI/CD typos, add .env to .gitignore, add maintenance TODOs

Reviewer Focus Areas

1. Overconfidence Directive Replacement (WS3) — behavioral change, needs careful review

Files: application-design.md, units-generation.md, infrastructure-design.md, nfr-design.md

The "Skip entire categories if not applicable" directive (identified as root cause of overconfidence in overconfidence-prevention.md) was replaced with a proactive evaluation pattern: MANDATORY evaluation of ALL categories with evidence-based applicability determination. This is an intentional behavioral change to how the AI agent operates — shifting from selective questioning to comprehensive evaluation. Please verify:

  • The replacement pattern matches the established model in requirements-analysis.md Step 5
  • The question categories are contextually appropriate for each file
  • The "when in doubt, ask the question" directive aligns with overconfidence-prevention.md

2. Code Planning/Code Generation Consolidation (WS2.3) — structural terminology change

Files: terminology.md, workflow-planning.md, error-handling.md, workflow-changes.md

"Code Planning" and "Code Generation" are merged into a single "Code Generation" stage (Part 1: Planning, Part 2: Generation). This affects:

  • Mermaid diagram nodes and edges in workflow-planning.md
  • Stage count in terminology.md (7 → 6 CONSTRUCTION stages)
  • Error handling section headings in error-handling.md
  • Warning message templates in workflow-changes.md

Please verify this aligns with the implementation in code-generation.md (the source of truth).

3. "Phase" vs "Stage" Terminology Sweep (WS2.2) — high volume, judgment calls

Files: error-handling.md (~11 changes), workflow-changes.md (pervasive), terminology.md, units-generation.md

Systematic replacement of "phase" with "stage" where individual workflow activities are meant. Phase is preserved where it correctly refers to INCEPTION/CONSTRUCTION/OPERATIONS. A few judgment calls were made:

  • error-handling.md:160 — "Operations phase" kept as-is (correctly refers to lifecycle phase)
  • error-handling.md:255 — "across phases" kept as-is (refers to lifecycle phases)

4. build-and-test.md Completion Message Reformat (WS5.2) — template change

File: build-and-test.md

The informal checkmark-style completion message was replaced with the standard REVIEW REQUIRED / WHAT'S NEXT template used by all other stages. Please verify:

  • The template structure matches other stage files (e.g., functional-design.md, nfr-design.md)
  • The content accurately reflects Build and Test stage outputs

5. OWASP Mapping Table Concern (WS7.1) — needs domain expertise

File: security-baseline.md:312

A strengthened TODO flags that the OWASP Top 10 "2025" mapping table may reference a non-existent edition (latest published is 2021). The category IDs and names need verification by someone with OWASP expertise.

6. README PowerShell Instructions (WS4.1) — platform-specific, needs Windows validation

File: README.md (Kiro and Amazon Q sections)

New Windows PowerShell setup blocks were added between the existing macOS/Linux and Windows CMD blocks. These use New-Item, Copy-Item, and $env:USERPROFILE syntax. Would benefit from validation on an actual Windows machine.

Lower-Risk Changes (spot-check sufficient)

Change Files Risk
Fix duplicate Step 1 → renumber Steps 1-13 reverse-engineering.md Low — mechanical renumbering
Fix "return to Step 14" → "Step 15" user-stories.md Low — single line
Fix cross-ref core-workflow.mdwelcome-message.md process-overview.md Low — verified file exists
Deprecated stage names (Context Assessment → Workspace Detection, etc.) 5 files Low — direct renames from filenames
Unicode → ASCII diagram welcome-message.md Low — per ascii-diagram-standards.md
Fix sentence fragment in audit.md rule core-workflow.md Low — clarity improvement
Spelling: "Applicabality", "Kisk", "Hardward" README.md, codebuild.yml, buildspec.yml Low — obvious typos
Add .env to .gitignore .gitignore Low — security hygiene
Add extensions/ to directory diagrams README.md (4 diagrams) Low — matches actual structure
Add ToC entries, fix tree connectors README.md Low — formatting
TODO comments (Amplify URL, OWASP) README.md, security-baseline.md Low — informational
Add LICENSE hyperlink README.md Low — consistency
Separate Kiro/Amazon Q troubleshooting README.md Low — clarity
Add ?raw=true to image tag README.md Low — consistency
Add .kiro/ and .amazonq/ to version control list README.md Low — completeness

Test Plan

  • Verify grep -r "Context Assessment" aidlc-rules/ returns 0 results
  • Verify grep -r "Requirements Assessment" aidlc-rules/ returns 0 results
  • Verify grep -r "Story Development" aidlc-rules/ returns 0 results
  • Verify grep -r "Skip entire categories" aidlc-rules/ returns only overconfidence-prevention.md
  • Verify Step headings in reverse-engineering.md are sequential 1-13
  • Verify .env appears in .gitignore
  • Verify no Unicode box-drawing characters in welcome-message.md
  • Verify extensions/ appears in all 4 README directory diagrams
  • Verify PowerShell blocks present in Kiro and Amazon Q README sections
  • Visual review of README rendered on GitHub (table not broken, images render)
  • Spot-check "phase" vs "stage" usage in error-handling.md and workflow-changes.md
  • Validate overconfidence directive replacements against requirements-analysis.md pattern

Related Issues

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

🤖 Generated with Claude Code

@raj-jain-aws raj-jain-aws self-assigned this Mar 18, 2026
scottschreckengaust and others added 4 commits March 23, 2026 13:40
Addresses ~33 issues identified across the repository documentation,
organized into 7 work streams covering correctness, consistency,
completeness, and style.

- Fix duplicate Step 1 heading in reverse-engineering.md; renumber
  Steps 1-13 sequentially
- Fix incorrect loop-back reference in user-stories.md Step 18:
  "return to Step 14" -> "return to Step 15" (Load Story Generation Plan)
- Fix broken cross-reference in process-overview.md: core-workflow.md
  (does not exist in rule-details/) -> welcome-message.md
- Add .env to .gitignore to prevent accidental secret commit

- Replace deprecated stage names across 6 files:
  "Context Assessment" -> "Workspace Detection",
  "Requirements Assessment" -> "Requirements Analysis",
  "Story Development" -> "User Stories",
  "Requirements Elaboration" -> "Requirements Analysis"
- Fix systematic "phase" vs "stage" confusion in error-handling.md,
  workflow-changes.md, terminology.md, and units-generation.md
  (phase = INCEPTION/CONSTRUCTION/OPERATIONS; stage = individual
  workflow activities within a phase)
- Resolve "Code Planning" ambiguity in terminology.md and
  workflow-planning.md: clarify Code Planning is Part 1 of the
  Code Generation stage, not a separate stage

- Remove stale "Skip entire categories if not applicable" directives
  from application-design.md, infrastructure-design.md, nfr-design.md,
  and units-generation.md
- Replace with proactive evaluation pattern modeled after
  requirements-analysis.md Step 5: evaluate ALL categories, determine
  applicability based on evidence, default to asking when in doubt

- Add missing Windows PowerShell setup instructions for Kiro and
  Amazon Q sections (macOS/Linux and Windows CMD already existed)
- Fix spelling: "Applicabality" -> "Applicability"
- Remove trailing space from "Verify in Kiro IDE" heading
- Add missing ToC entries: Version Control Recommendations, Security,
  License, Other Agents
- Add extensions/ subdirectory to all 4 platform directory structure
  diagrams (Cursor, Cline, Claude Code, GitHub Copilot)
- Fix Extension Directory Structure tree connector (└── -> ├── for
  baseline/ which has siblings)
- Add .kiro/ and .amazonq/ rule-details paths to Version Control
  Recommendations
- Separate Kiro and Amazon Q troubleshooting into distinct sections
  (/context show is Kiro-only)
- Add ?raw=true to kiro-sdd-nudge.png image tag for consistency
- Add TODO comments for Amplify URL replacement with stable URL
- Add LICENSE hyperlink for consistency with CONTRIBUTING.md links

- Replace Unicode box-drawing characters in welcome-message.md
  diagram with ASCII equivalents per ascii-diagram-standards.md
- Standardize build-and-test.md completion message to use the
  REVIEW REQUIRED / WHAT'S NEXT template matching all other stages;
  also fixes extra double-quote on completion line
- Fix incomplete sentence fragment in core-workflow.md line 475:
  rewrite as complete prohibition statement

- Fix typos in codebuild.yml and buildspec.yml:
  "Kisk" -> "Disk", "Hardward" -> "Hardware"
- Add buildspec.yml (CodeBuild build specification)

- Add TODO near OWASP Top 10 (2025) mapping table in
  security-baseline.md to verify year against latest edition
- Add TODO HTML comments near Amplify URLs in README.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Fixes 5 issues identified during code review of the docs commit:

1. terminology.md: Update stale "Code Planning stage" references
   - Line 13: "Code Planning stage" -> "Code Generation stage" in examples
   - Line 18: "7 stages" -> "6 stages" (after merging Code Planning
     into Code Generation)
   - Line 19: "Code Planning stage" -> "Code Generation stage" in
     usage example

2. README.md: Move TODO HTML comment above the markdown table to
   prevent breaking GitHub-Flavored Markdown table rendering (comment
   between header separator and first data row terminates the table)

3. core-workflow.md: Fix canonical stage name "NFR Requirements
   Analysis" -> "NFR Requirements" to match usage elsewhere in the
   same file (line 349: "NFR Requirements was executed")

4. Align dash style in overconfidence directives: change "--" to "-"
   in application-design.md, units-generation.md, infrastructure-
   design.md, nfr-design.md to match the canonical style in
   overconfidence-prevention.md and 3 other files

5. Align contraction in overconfidence directives: change "It is
   better" to "It's better" in the same 4 files to match the
   canonical wording in overconfidence-prevention.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Fixes 7 issues identified during the pr-review-toolkit comprehensive
review of the documentation remediation branch.

1. workflow-changes.md:88 - Remove stale "Code Planning" from the
   user warning message template. The restart impact warning now
   lists "Code Generation" as a single stage instead of the previous
   "Code Planning, Code Generation" pair.

2. error-handling.md:133,145 - Consolidate "Code Planning Errors"
   and "Code Generation Errors" section headings into
   "Code Generation Errors (Part 1: Code Planning)" and
   "Code Generation Errors (Part 2: Code Generation)" to align
   with the Code Planning/Code Generation stage merger applied
   everywhere else.

3. error-handling.md:48 - Fix "Cannot determine required phases"
   to "required stages". This appears in the Workspace Detection
   Errors section and refers to individual workflow stages, not
   the three lifecycle phases (INCEPTION/CONSTRUCTION/OPERATIONS).

4. build-and-test.md:345 - Fix "Log the phase completion" to
   "Log the stage completion". Build and Test is a stage within
   the CONSTRUCTION phase. This was newly added text in the
   previous commit.

5. build-and-test.md:326 - Add trailing two-space markdown line
   break to the REVIEW REQUIRED blockquote line, matching the
   pattern used in all other stage completion message templates
   (functional-design.md, nfr-design.md, infrastructure-design.md,
   code-generation.md, etc.).

6. security-baseline.md:312 - Strengthen the OWASP TODO comment
   from a simple "verify the year" note to a CRITICAL flag that
   the entire mapping table (category IDs, numbering, and names)
   needs verification against the actual published OWASP Top 10
   standard (currently 2021 edition). The "2025" edition
   referenced in the table may not exist.

7. .gitignore - Add trailing newline for POSIX compliance. The
   file previously lacked a final newline, which can cause issues
   with some tools that expect POSIX text files.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Revert CI/CD file changes that are out of scope for this
documentation remediation PR:

- Remove buildspec.yml (new file — should be tracked separately)
- Revert codebuild.yml spelling fixes and sts identity command
  (infrastructure changes, not documentation)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@scottschreckengaust scottschreckengaust force-pushed the docs/comprehensive-documentation-review-remediation branch from d5af3ec to fea6037 Compare March 23, 2026 13:44
@scottschreckengaust scottschreckengaust marked this pull request as ready for review March 23, 2026 13:50
@scottschreckengaust scottschreckengaust requested review from a team as code owners March 23, 2026 13:50
Copy link
Contributor

@harmjeff harmjeff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Completed review and agree this is good

@harmjeff harmjeff self-requested a review March 25, 2026 13:50
Copy link
Contributor

@harmjeff harmjeff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Completed review and agree this is good

Copy link
Contributor

@spraja08 spraja08 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed. Good to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants