|
| 1 | +--- |
| 2 | +file_type: documentation |
| 3 | +version: "3.0" |
| 4 | +author: "LightSpeedWP Team" |
| 5 | +maintainer: "LightSpeedWP Team" |
| 6 | +mode: "information" |
| 7 | +stability: "stable" |
| 8 | +domain: "governance" |
| 9 | +deprecated: false |
| 10 | +references: |
| 11 | + - path: "docs/VERSIONING.md" |
| 12 | + description: "Versioning guidelines for documentation" |
| 13 | + - path: "docs/CHATMODE-FRONTMATTER.md" |
| 14 | + description: "Chatmode frontmatter standards" |
| 15 | + - path: ".github/automation/AUTOMATION_GOVERNANCE.md" |
| 16 | + description: "Automation governance and policies" |
| 17 | + - path: "docs/LABEL_STRATEGY.md" |
| 18 | + description: "Labeling strategy and policies" |
| 19 | + - path: "docs/LABELING_AGENT_USAGE.md" |
| 20 | + description: "Labeling agent usage guide" |
| 21 | +tags: |
| 22 | + - documentation |
| 23 | + - audit |
| 24 | + - governance |
| 25 | + - quality-assurance |
| 26 | + - maintenance |
| 27 | +title: "Documentation Audit & Gap Analysis for LightSpeedWP/.github Repository" |
| 28 | +description: "Comprehensive audit of documentation structure, identifying gaps, inconsistencies, and recommendations for improvement" |
| 29 | +created_date: "2025-11-12" |
| 30 | +last_updated: "2025-11-12" |
| 31 | +--- |
| 32 | + |
| 33 | +# Documentation Audit & Gap Analysis for LightSpeedWP/.github Repository |
| 34 | + |
| 35 | +## Overview & Current Documentation Structure |
| 36 | + |
| 37 | +LightSpeedWP's **`.github` repository** serves as the central hub for organization-wide templates, automation, and community health files. It contains a variety of documentation and configuration files, broadly categorized as: |
| 38 | + |
| 39 | +* **Community & Governance Docs:** e.g. `CODE_OF_CONDUCT.md`, `CONTRIBUTING.md`, `GOVERNANCE.md`, `SECURITY.md`, `SUPPORT.md` – guidelines for behavior, contributions, and project governance. |
| 40 | + |
| 41 | +* **AI & Copilot Instructions:** e.g. `AGENTS.md` (AI agents index), `CLAUDE.md` and `GEMINI.md` (AI configuration), plus custom instruction and prompt files (currently all under `.github/` folder). |
| 42 | + |
| 43 | +* **Automation & Workflow Docs:** e.g. `AUTOMATION_GOVERNANCE.md` (automation policies), labeling config (`labels.yml`, `labeler.yml`, `issue-types.yml`), and related documentation such as **labeling strategy** and **agent usage guides**. |
| 44 | + |
| 45 | +* **Schemas & Validation:** JSON schemas (like `frontmatter.schema.json`) and docs describing frontmatter and tagging conventions. |
| 46 | + |
| 47 | +* **Project Management Files:** Changelog (`CHANGELOG.md`), version info (`VERSION` file), roadmap and decision records (in `docs/ROADMAP.md`, `docs/DECISIONS.md`, etc). |
| 48 | + |
| 49 | +Each document category plays a role in ensuring consistency across all LightSpeed repos. However, this audit has uncovered **inconsistencies, outdated links, and missing pieces** that need attention. |
| 50 | + |
| 51 | +## Key Findings & Issues |
| 52 | + |
| 53 | +### 1. Outdated or Broken Links |
| 54 | + |
| 55 | +* **Branch References:** Some internal links still point to the **`master`** branch instead of the default **`develop`** branch. For example, the *Labeling Agent Usage* doc's references to "Coding Standards" and "Custom Instructions" use a `blob/master` URL, which is likely broken given that `develop` is the active branch. These should be updated to use relative links or the correct branch to avoid 404 errors. |
| 56 | + |
| 57 | +* **Moved Files & Incorrect Paths:** A recent reorganization moved certain **automation files into a subfolder**, but not all documentation was updated. For instance, the central label config files (`labels.yml`, `labeler.yml`) were moved to the `automation/` directory, yet some docs or references still assume they are in the root `.github/` directory. These inconsistent path references need to be reconciled. |
| 58 | + |
| 59 | +* **Cross-Repo Linking:** There are references intended to point to files within this repo (like linking to `.github/instructions/...` paths). All such links should be tested. Some may still target old locations (e.g. the **Tagging & Frontmatter conventions** instructions file path). Ensuring all internal links use the new structure (or at least relative paths that remain valid after moves) is crucial to avoid broken documentation. |
| 60 | + |
| 61 | +### 2. Inconsistencies in Documentation Content |
| 62 | + |
| 63 | +* **Frontmatter Schema Placement:** The **unified frontmatter schema** file (`frontmatter.schema.json`) is currently located at the root of the `schemas/` directory. It would be more logical to move it into a dedicated `schemas/frontmatter/` subfolder for better organization (e.g. `schemas/frontmatter/schema.json`). This aligns with the repository's goal of structured schemas. |
| 64 | + |
| 65 | +* **Awesome-Copilot vs LightSpeed Conventions:** Some instruction documents originated from the "awesome-copilot" project and still contain legacy conventions that conflict with LightSpeed's needs. Notably, the **tagging and frontmatter conventions** guide needs updating to include LightSpeed-specific frontmatter fields and to resolve any conflicts with the original awesome-copilot guidelines. |
| 66 | + |
| 67 | +* **Duplicate or Overlapping Info:** There is potential overlap between different documents. For example, **AGENTS.md** (the main index of AI agents) and the individual agent spec files (e.g. files in an `agents/` directory) need to be in sync. Similarly, **custom instruction** files vs. **global instructions**: the repository plans to have per-repo `custom-instructions.md` in each project linking back to central ones. We must ensure the central instructions (in the `.github` repo) are generic and do not conflict with specialized per-repo instructions. |
| 68 | + |
| 69 | +### 3. Status of Previously Missing Documents |
| 70 | + |
| 71 | +Several documents that were identified as potential gaps have been found to exist: |
| 72 | + |
| 73 | +* **VERSIONING.md** ✓ - Exists at `docs/VERSIONING.md` with comprehensive guidelines on semantic versioning, changelog management, and version control practices. |
| 74 | + |
| 75 | +* **CHATMODE-FRONTMATTER.md** ✓ - Exists at `docs/CHATMODE-FRONTMATTER.md` with detailed documentation on chatmode file frontmatter standards. |
| 76 | + |
| 77 | +* **AUTOMATION_GOVERNANCE.md** ✓ - Exists at `.github/automation/AUTOMATION_GOVERNANCE.md` documenting automation policies and governance. |
| 78 | + |
| 79 | +* **chatmodes.md** ✓ - Master index exists at `.github/chatmodes/chatmodes.md`. |
| 80 | + |
| 81 | +However, these documents should be reviewed to ensure they are: |
| 82 | +- Up-to-date with current practices |
| 83 | +- Properly cross-referenced in other documentation |
| 84 | +- Free from the link and path issues identified above |
| 85 | + |
| 86 | +### 4. AI Instructions & Prompt Files Audit |
| 87 | + |
| 88 | +All AI-related instruction files should be reviewed for consistency and efficacy: |
| 89 | + |
| 90 | +* **Custom vs Global Instructions:** The `.github` repository holds global AI copilot instructions (e.g., coding standards, tagging conventions, Mermaid diagram guidelines) likely intended to apply across the organization. However, the plan is to allow individual repos to override or augment these via a `custom-instructions.md` in each repo that links back to the main ones. We need to ensure the **global instructions** are not too intrusive or contradictory. |
| 91 | + |
| 92 | +* **Prompts & Agents Index:** `AGENTS.md` should list all agent files (like `labeling.agent.md`, any "branding" agents, etc.) and summarize their purpose. If new agents (such as a future "metrics agent" or others) are added, `AGENTS.md` must be updated. |
| 93 | + |
| 94 | +* **Branding Agents Placeholder:** Documentation for any branding or marketing-related AI agents is pending. We should include a placeholder note in the relevant index (or a section in `AGENTS.md`) that a detailed description will be added once defined. |
| 95 | + |
| 96 | +### 5. Mermaid Diagrams Accessibility Issues |
| 97 | + |
| 98 | +The repository heavily uses **Mermaid diagrams** in documentation (for workflows, process flows, task breakdowns, etc.). While these diagrams are excellent for visualization, many currently suffer from **poor color contrast and readability**. Specific issues include: |
| 99 | + |
| 100 | +* Low contrast between node background and text (especially if Mermaid's default dark theme is used). |
| 101 | +* Small font sizes in rendered diagrams and no alternative text descriptions for those who can't see the image. |
| 102 | + |
| 103 | +To address this, diagrams should be updated for accessibility: |
| 104 | + |
| 105 | +* Use a light background with dark text or vice-versa in Mermaid (Mermaid allows styling classes – we can define a class with accessible colors and apply it to all nodes). |
| 106 | +* Increase font size or bold important text in the diagram if possible. |
| 107 | +* Provide an **alt-text or caption** for each diagram describing what it depicts (this can be done by a preceding paragraph). |
| 108 | + |
| 109 | +### 6. Labeling & Automation Discrepancies |
| 110 | + |
| 111 | +Labeling is one of the most critical automated systems in this repo. A few discrepancies or points needing clarification: |
| 112 | + |
| 113 | +* The **label config files** are confirmed to be in `.github/automation/` directory (labels.yml, labeler.yml, issue-types.yml). Documentation should consistently reference this location. |
| 114 | + |
| 115 | +* **Issue Type application:** The documentation mentions automatic issue type labeling from titles or content. If there are any differences between what's documented and what the agent actually does, those need syncing. |
| 116 | + |
| 117 | +* **Workflow vs Documentation:** Ensure that the documented **"one-hot" status enforcement and required labels** match what the workflows enforce in practice. |
| 118 | + |
| 119 | +## Recommendations & Action Items |
| 120 | + |
| 121 | +Based on the gaps identified, here is a list of recommended actions and the creation/update of specific documents: |
| 122 | + |
| 123 | +### Immediate Actions |
| 124 | + |
| 125 | +1. **Fix Broken Links and Paths** |
| 126 | + - Update all internal links to use correct relative paths and branch references |
| 127 | + - Change any `.../blob/master/...` URLs to `.../blob/develop/...` or use relative links |
| 128 | + - Verify links to files in `automation/` directory are correct |
| 129 | + - **Priority:** High |
| 130 | + |
| 131 | +2. **Relocate Frontmatter Schema** (Optional) |
| 132 | + - Consider moving `frontmatter.schema.json` into `schemas/frontmatter/` folder |
| 133 | + - Update any references in documentation to the new path |
| 134 | + - Ensure validation scripts point to the new location |
| 135 | + - **Priority:** Medium |
| 136 | + |
| 137 | +3. **Review and Update Existing Documentation** |
| 138 | + - Audit `docs/VERSIONING.md` for accuracy and completeness |
| 139 | + - Review `docs/CHATMODE-FRONTMATTER.md` for LightSpeed-specific needs |
| 140 | + - Verify `.github/automation/AUTOMATION_GOVERNANCE.md` reflects current processes |
| 141 | + - Ensure all cross-references between docs are valid |
| 142 | + - **Priority:** High |
| 143 | + |
| 144 | +4. **Update Agents & Prompts Indexes** |
| 145 | + - Bring `AGENTS.md` up to date by listing all current agents |
| 146 | + - Cross-reference with individual agent specs in `agents/` folder |
| 147 | + - Create or update `prompts.md` index for prompt templates |
| 148 | + - Add placeholder entries for planned agents (e.g., branding agents, metrics agent) |
| 149 | + - **Priority:** Medium |
| 150 | + |
| 151 | +5. **Improve Mermaid Diagram Styling** |
| 152 | + - Define custom accessible style for all Mermaid diagrams |
| 153 | + - Document style guidelines in `mermaid-diagrams.instructions.md` |
| 154 | + - Add descriptive captions below each diagram |
| 155 | + - Re-generate diagrams with poor contrast |
| 156 | + - **Priority:** Medium |
| 157 | + |
| 158 | +6. **Refresh README Files in Subfolders** |
| 159 | + - Audit all subfolder READMEs (docs/, scripts/, tests/, etc.) |
| 160 | + - Ensure standardized frontmatter in all README files |
| 161 | + - Add footer with references as per project conventions |
| 162 | + - **Priority:** Low |
| 163 | + |
| 164 | +7. **Implement Metrics Tracking** |
| 165 | + - Set up Metrics workflow and agent to gather repository health data |
| 166 | + - Create `docs/METRICS.md` documentation |
| 167 | + - Define key metrics (documentation coverage, automation effectiveness, etc.) |
| 168 | + - Add badges to README for key metrics |
| 169 | + - **Priority:** Low |
| 170 | + |
| 171 | +### Documentation Review Checklist |
| 172 | + |
| 173 | +For each existing document, verify: |
| 174 | + |
| 175 | +- [ ] Frontmatter is complete and follows LightSpeed standards |
| 176 | +- [ ] All internal links use relative paths or correct branch references |
| 177 | +- [ ] References to moved files (automation/, etc.) are updated |
| 178 | +- [ ] Cross-references between related docs are bidirectional |
| 179 | +- [ ] Mermaid diagrams have accessible styling and captions |
| 180 | +- [ ] Version and last_updated fields are current |
| 181 | +- [ ] Tags are consistent with other similar documents |
| 182 | + |
| 183 | +### Ongoing Best Practices |
| 184 | + |
| 185 | +1. **Documentation Linting:** Run markdownlint regularly and fix issues |
| 186 | +2. **Link Checking:** Use automated link checker to catch broken links early |
| 187 | +3. **Changelog Updates:** Keep `CHANGELOG.md` current with significant documentation changes |
| 188 | +4. **Version Bumping:** Follow versioning policy when making material changes to docs |
| 189 | +5. **Regular Audits:** Conduct quarterly documentation audits to prevent drift |
| 190 | + |
| 191 | +## Conclusion |
| 192 | + |
| 193 | +The LightSpeedWP `.github` repository has a solid documentation foundation, with many critical documents already in place. The primary issues are: |
| 194 | + |
| 195 | +1. **Link maintenance** - outdated branch references and paths after file reorganization |
| 196 | +2. **Consistency** - ensuring all documentation reflects current file locations and practices |
| 197 | +3. **Accessibility** - improving Mermaid diagrams for better readability |
| 198 | +4. **Discoverability** - keeping indexes (AGENTS.md, prompts.md) up-to-date |
| 199 | + |
| 200 | +By addressing these issues systematically, we ensure this repo truly serves as a reliable "single source of truth" for all projects in the organization. Each recommended action should be treated as a separate deliverable, ideally tracked in GitHub Issues with appropriate labels and milestones. |
| 201 | + |
| 202 | +Going forward, maintaining a change log for documentation and regularly auditing links will prevent such drift from happening again. With these improvements, the LightSpeedWP `.github` repository will robustly support our open-source community and internal teams alike. |
| 203 | + |
| 204 | +--- |
| 205 | + |
| 206 | +**Next Steps:** |
| 207 | + |
| 208 | +1. Create GitHub issues for each recommended action |
| 209 | +2. Prioritize based on impact and effort |
| 210 | +3. Assign to appropriate maintainers |
| 211 | +4. Track progress in project board |
| 212 | +5. Schedule follow-up audit in Q2 2026 |
0 commit comments