Skip to content

Commit b083acb

Browse files
committed
reorganize page for clarity
1 parent da4bb1b commit b083acb

File tree

2 files changed

+19
-26
lines changed

2 files changed

+19
-26
lines changed

.vale/styles/FernStyles/Acronyms.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -68,3 +68,4 @@ exceptions:
6868
- MDX # Fern-specific
6969
- SEO # Fern-specific
7070
- AWS # Fern-specific
71+
- LLM # Fern-specific
Lines changed: 18 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,23 @@
11
---
22
title: llms.txt
3-
subtitle: Enable tools like Cursor, GitHub Copilot, ChatGPT, and Claude to quickly understand your documentation.
4-
description: Learn how your documentation becomes accessible to AI tools using the llms.txt standard. Make your docs AI-friendly.
5-
layout: guide
3+
description: Enable tools like Cursor, GitHub Copilot, ChatGPT, and Claude to understand your documentation.
64
---
75

8-
## What is llms.txt?
9-
[LLMs.txt](https://llmstxt.org/) is an emerging standard so that websites can easily expose information to AI developer tools.
10-
LLMs thrive on concise, structured information, and `llms.txt` help them locate and interpret key information in your developer documentation with ease.
11-
No configuration required--your `llms.txt` files are automatically generated and maintained, just like a `sitemap.xml` or `robots.txt`.
6+
[llms.txt](https://llmstxt.org/) is a standard for exposing website content to AI developer tools. Fern automatically generates and maintains `llms.txt` and `llms-full.txt` files for your documentation site.
127

13-
### llms.txt
14-
- **Small and fast**: Quick to load and easy to parse.
15-
- **Summary-focused**: Each page distilled into a one-sentence description with its URL.
16-
- **Structured for AI**: Helps tools understand the overall structure of your documentation.
8+
## `llms.txt`
179

18-
See an example: [docs.cohere.com/llms.txt](https://docs.cohere.com/llms.txt)
19-
20-
### llms-full.txt
21-
- **Comprehensive**: Includes the full content of your documentation.
22-
- **API-ready**: Automatically incorporates your complete API Reference with resolved OpenAPI specifications and SDK code examples for all languages you've enabled. Each API endpoint page includes its full OpenAPI spec.
23-
- **Token efficient**: When Fern detects an LLM bot, it automatically serves Markdown content from the llms.txt file instead of HTML, reducing token consumption by 90%+.
24-
25-
See an example: [docs.cohere.com/llms-full.txt](https://docs.cohere.com/llms-full.txt)
10+
Contains a lightweight summary of your documentation site with each page distilled into a one-sentence description and URL. The format is structured to help AI tools parse and understand your documentation's hierarchy and organization.
2611

27-
## Analytics and monitoring
12+
See an example: [docs.cohere.com/llms.txt](https://docs.cohere.com/llms.txt)
2813

29-
Fern tracks comprehensive analytics for llms.txt usage in the Fern Dashboard, including:
30-
- LLM traffic by provider (Claude, ChatGPT, Cursor, etc.)
31-
- Traffic breakdown for .md and llms.txt files by agents and humans
14+
## `llms-full.txt`
3215

33-
This visibility helps you understand LLM traffic patterns and optimize your documentation for AI consumption.
16+
Contains complete documentation content including the full text of all pages. For API documentation, this includes your complete API Reference with resolved OpenAPI specifications and SDK code examples for enabled languages. Each API endpoint page includes its full OpenAPI spec.
3417

35-
## View in action
18+
When Fern detects an LLM bot accessing your documentation, it automatically serves Markdown instead of HTML, reducing token consumption by 90%+.
3619

37-
Check out the llms.txt files for this site:
20+
View the llms.txt files for this site:
3821
- `https://buildwithfern.com/learn/llms.txt`
3922
- `https://buildwithfern.com/learn/llms-full.txt`
4023

@@ -45,3 +28,12 @@ Check out the llms.txt files for this site:
4528
className="rounded-lg border border-gray-200 dark:border-gray-700"
4629
/>
4730
</Frame>
31+
32+
## Analytics and monitoring
33+
34+
The [Fern Dashboard](https://dashboard.buildwithfern.com/) provides comprehensive analytics for llms.txt usage including:
35+
- Traffic by LLM provider (Claude, ChatGPT, Cursor, etc.)
36+
- Page-level breakdowns of bot vs. human visitors for `.md` and `llms.txt` files
37+
38+
This visibility helps you understand LLM traffic patterns and optimize your documentation for AI consumption.
39+

0 commit comments

Comments
 (0)