Support for llms.js to dynamically generate llms.txt similar to robots.txt and sitemap.xml

[boraoksuzoglu]

Goals

1. Enable developers to create a llms.txt file dynamically using a file-based convention (app/llms.js) like sitemap.js and robots.js.
2. Provide consistent handling of metadata/text-based routes under the App Router.
3. Support for dynamic regeneration

Non-Goals

No response

Background

Currently, Next.js supports automatic route generation for sitemap.xml and robots.txt when developers create app/sitemap.js and app/robots.js, respectively. This system allows for declarative and optionally dynamic creation of standard metadata files used by crawlers.

In the same way, there’s a growing need to support the emerging llms.txt standard, which is being adopted to declare how websites interact with large language models. Having a dedicated file like llms.js that maps to a llms.txt route would fit naturally into the existing file-based routing and metadata system in Next.js.

Proposal

example: https://developers.cloudflare.com/llms.txt

// app/llms.js

export default async function llms() {
	const llmsData = {
		title: "Cloudflare Developer Documentation",
		description:
			"Easily build and deploy full-stack applications everywhere, thanks to integrated compute, storage, and networking.",
		sections: [
			{
				title: "Agents",
				links: [
					[
						"Build Agents on Cloudflare",
						"https://developers.cloudflare.com/agents/index.md",
					],
					[
						"Browse the web",
						"https://developers.cloudflare.com/agents/api-reference/browse-the-web/index.md",
					],
					[
						"Agents API",
						"https://developers.cloudflare.com/agents/api-reference/agents-api/index.md",
					],
				],
			},
			{
				title: "AI Gateway",
				links: [
					[
						"AI Assistant",
						"https://developers.cloudflare.com/ai-gateway/ai/index.md",
					],
					[
						"REST API reference",
						"https://developers.cloudflare.com/ai-gateway/api-reference/index.md",
					],
					[
						"Changelog",
						"https://developers.cloudflare.com/ai-gateway/changelog/index.md",
					],
				],
			},
		],
	};

	return llmsData;
}

// WEBSITE_URL/llms.txt

# Cloudflare Developer Documentation

Easily build and deploy full-stack applications everywhere,
thanks to integrated compute, storage, and networking.

## Agents

- [Build Agents on Cloudflare](https://developers.cloudflare.com/agents/index.md)
- [Browse the web](https://developers.cloudflare.com/agents/api-reference/browse-the-web/index.md)
- [Agents API](https://developers.cloudflare.com/agents/api-reference/agents-api/index.md)

## AI Gateway

- [AI Assistant](https://developers.cloudflare.com/ai-gateway/ai/index.md)
- [REST API reference](https://developers.cloudflare.com/ai-gateway/api-reference/index.md)
- [Changelog](https://developers.cloudflare.com/ai-gateway/changelog/index.md)

[icyJoseph]

Note that you can today, already do /app/llms.txt/route.ts, and define a GET handler, that serves this text content.

export const dynamic = 'force-static'; // or make it dynamic if you want

export function GET() {
  return new Response(`# Hello World`);
}

Same with llms-full.txt.

• https://vercel.com/docs/llms-full.txt
• https://vercel.com/docs/llms.txt

[boraoksuzoglu]

Oh, that's great, thanks.

I just tested it and it works perfectly. I also used this helper function to render the text dynamically from structured data:

function renderMarkdown(data) {
	let output = `# ${data.title}\n\n${data.description}\n\n`;

	for (const section of data.sections) {
		output += `## ${section.title}\n\n`;
		for (const [text, url] of section.links) {
			output += `- [${text}](${url})\n`;
		}
		output += `\n`;
	}

	return output;
}