Update llms.txt documentation with analytics and technical details

Co-Authored-By: Devin Logan <[email protected]>

Author: devin-ai-integration[bot]

fern/products/docs/pages/seo/llms-txt.mdx

@@ -19,11 +19,23 @@ See an example: [docs.cohere.com/llms.txt](https://docs.cohere.com/llms.txt)
 
 ### llms-full.txt
 - **Comprehensive**: Includes the full content of your documentation.
-- **API-Ready**: Automatically incorporates your full API reference and SDK snippets (if generated by Fern).
+- **API-Ready**: Automatically incorporates your full API reference with OpenAPI specifications and SDK code examples (if generated by Fern).
 - **Token efficient**: Removes unnecessary formatting to be as token-efficient as possible.
 
 See an example: [docs.cohere.com/llms-full.txt](https://docs.cohere.com/llms-full.txt)
 
+## Analytics and Monitoring
+
+Fern tracks comprehensive analytics for llms.txt usage to help you understand how AI tools are consuming your documentation. The system monitors performance metrics including load times, processing times, and content length. User agent detection automatically identifies bot traffic versus browser requests, and detailed logging captures request headers for deeper insights.
+
+These analytics are available in the Fern dashboard, where you can view dedicated tables for llms.txt and markdown file access, along with channel attribution and device type information. This visibility helps you understand LLM traffic patterns and optimize your documentation for AI consumption.
+
+## Technical Details
+
+The llms.txt generation system handles complex schema types including self-referencing schemas, preventing infinite recursion during content generation. For large documentation sites, the system uses optimized timeouts to ensure reliable content delivery without timing out.
+
+For REST API endpoints, the markdown generation includes OpenAPI specifications in YAML format, making it easy for LLMs to understand your API structure. The same markdown generation logic is used for both serving llms.txt files and indexing content for search, ensuring consistency across your documentation platform.
+
 ## View in Action
 
 Check out the llms.txt files for this site:
@@ -36,4 +48,4 @@ Check out the llms.txt files for this site:
     alt="Example of using llms.txt"
     className="rounded-lg border border-gray-200 dark:border-gray-700"
   />
-</Frame>
+</Frame>