feat(community): add AI Website Pipeline

[theluckystrike]

What

Adds a single new community entry: AI Website Pipeline (aiwebsitepipeline.com).

• packages/content/data/websites/aiwebsitepipeline-llms-txt.mdx

llms.txt

• https://aiwebsitepipeline.com/llms.txt — live, returns 200, plain text.
• No llms-full.txt yet, so llmsFullUrl is intentionally left empty rather than pointed at a URL that does not exist.

Notes

• Category: ai-ml.
• data/websites.json is deliberately untouched — per CONTRIBUTING.md it is generated and manual edits are rejected.
• This replaces feat(websites): add ToolsThatRank, handsofflinks and AI Website Pipeline #1472, which bundled three unrelated sites into one PR. I have closed that one; this PR is one site only, and correctly titled feat(community): so PR Intake actually runs.

Summary by CodeRabbit

• Documentation
  • Added an AI Website Pipeline entry with descriptive metadata and content.
  • Documented its llms.txt implementation, covered subjects, and related open-source libraries.

[github-actions]

PR intake summary

• Lane: mdx-fast
• Risk: low
• Automerge eligible: yes
• data/websites.json touched: no
• Manual websites.json change: no
• File count: 1
• Total changes: 23
• Labels: lane:mdx-fast, risk:low, automerge:candidate, area:content
• Reason: PR only adds new .mdx entries under packages/content/data/websites/**.
• Inspected files:
  • packages/content/data/websites/aiwebsitepipeline-llms-txt.mdx

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 8f13e755-f741-47b6-ae81-a0941cfc0944

📥 Commits

Reviewing files that changed from the base of the PR and between 0e9cd30 and 1607177.

📒 Files selected for processing (1)

• packages/content/data/websites/aiwebsitepipeline-llms-txt.mdx

Included review availability: Your plan includes up to 4 reviews per rolling hour; 3 remain after this review.

---

Walkthrough

Adds an AI Website Pipeline entry with metadata, implementation details, llms.txt coverage, documented subjects, and related open-source libraries.

Changes

AI Website Pipeline entry

Layer / File(s)	Summary
Website metadata and documentation packages/content/data/websites/aiwebsitepipeline-llms-txt.mdx	Adds entry metadata and documents the local agentic pipeline, contract and gate behavior, llms.txt coverage, subjects, gate-contract, and indexnowkit.

Estimated code review effort: 2 (Simple) | ~10 minutes

Merge Risk: ⚪ Minimal · up to 16071

This change adds a single community website entry without modifying generated data or runtime behavior, so no actionable merge-blocking risk remains after normal checks and review.

Possibly related PRs

• thedaviddias/llms-txt-hub#1472: Adds the same aiwebsitepipeline-llms-txt.mdx entry.
• thedaviddias/llms-txt-hub#1399: Adds a similar website-specific MDX content entry.
• thedaviddias/llms-txt-hub#1412: Adds a similar website entry under the same directory.

Suggested reviewers: thedaviddias

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly identifies the addition of the AI Website Pipeline community entry.
Description check	✅ Passed	The description explains the change, endpoint details, category, generated-file constraint, and scope, but it omits the template's "## Summary" heading.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

Warning

Review ran into problems

🔥 Problems

These MCP integrations need to be re-authenticated in the Integrations settings: Sentry

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}