Skip to content

feat(docs): add Answer Engine Optimization (AEO) features#7

Merged
rubenmarcus merged 6 commits intomainfrom
add-more-stuff
Jan 30, 2026
Merged

feat(docs): add Answer Engine Optimization (AEO) features#7
rubenmarcus merged 6 commits intomainfrom
add-more-stuff

Conversation

@rubenmarcus
Copy link
Copy Markdown
Member

@rubenmarcus rubenmarcus commented Jan 29, 2026

Summary

Adds Answer Engine Optimization (AEO) features to make the documentation more discoverable and useful for AI systems.

Changes

  • robots.txt - Explicitly allows AI crawlers (GPTBot, Claude-Web, PerplexityBot) to index documentation
  • FAQ page - Structured Q&A format for common questions about usage, integrations, and troubleshooting
  • JSON-LD schemas - SoftwareApplication and WebSite structured data for better AI understanding
  • AI-friendly meta tags - Robots meta with max snippets enabled

Files Changed

  • docs/static/robots.txt - AI crawler permissions
  • docs/docs/faq.md - FAQ page with structured answers
  • docs/docusaurus.config.ts - JSON-LD schemas and meta tags

🤖 Generated with Claude Code

@cloudflare-workers-and-pages
Copy link
Copy Markdown

cloudflare-workers-and-pages bot commented Jan 29, 2026

Deploying ralph-starter with  Cloudflare Pages  Cloudflare Pages

Latest commit: 8d814de
Status: ✅  Deploy successful!
Preview URL: https://d3965933.ralph-starter.pages.dev
Branch Preview URL: https://add-more-stuff.ralph-starter.pages.dev

View logs

rubenmarcus and others added 4 commits January 29, 2026 23:45
Explicitly allows GPTBot, Claude-Web, PerplexityBot, and other AI
crawlers to index the documentation for Answer Engine Optimization.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Updated CSS to display content like a .md file:
- Shows links as [text](url) with full URL visible
- Headings prefixed with # symbols
- Lists with - prefix
- Code blocks with ``` markers
- Hides all images and decorative elements
- Plain text only, no styling

Inspired by parallel.ai's machine view.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Structured Q&A format helps AI systems extract and answer questions about:
- General usage and installation
- Integrations (GitHub, Linear, Notion)
- MCP server setup
- Troubleshooting common issues
- Contributing

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Added for Answer Engine Optimization (AEO):
- SoftwareApplication schema for the CLI tool
- WebSite schema for documentation discovery
- AI-friendly robots meta tag with max snippets

Helps AI systems understand and reference the project.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@rubenmarcus rubenmarcus self-assigned this Jan 29, 2026
Removed for now:
- MachineToggle component
- NavbarItem/ComponentTypes.js
- Machine mode CSS styles
- Navbar toggle item

Keeping AEO features: robots.txt, llms.txt, FAQ, JSON-LD schemas.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@rubenmarcus rubenmarcus merged commit 82cb05b into main Jan 30, 2026
5 checks passed
@rubenmarcus rubenmarcus deleted the add-more-stuff branch January 30, 2026 01:25
@rubenmarcus rubenmarcus changed the title feat: add more stuff feat(docs): add Answer Engine Optimization (AEO) features Jan 30, 2026
rubenmarcus added a commit that referenced this pull request Jan 30, 2026
rubenmarcus added a commit that referenced this pull request Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant