Add pagination for llms-full.txt file

[conico974]

Implement pagination for the llms-full.txt file to improve performance and fix errors for very big files.

[linear]

RND-7957 Internal Server Error on llms-full.txt for MariaDB

[changeset-bot]

⚠️ No Changeset found

Latest commit: d3b09c9

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[github-actions]

Summary of the deployments:

Version	URL	Status
Vercel	https://gitbook-v2-jxhkarp9z-gitbook.vercel.app	✅
Cloudflare	https://8a394f60-gitbook-open-v2-preview.gitbook.workers.dev	✅

Test content

Site	2v	2c
GitBook	https://gitbook-v2-jxhkarp9z-gitbook.vercel.app/url/gitbook.com/docs	https://8a394f60-gitbook-open-v2-preview.gitbook.workers.dev/url/gitbook.com/docs
E2E	https://gitbook-v2-jxhkarp9z-gitbook.vercel.app/url/gitbook.gitbook.io/test-gitbook-open	https://8a394f60-gitbook-open-v2-preview.gitbook.workers.dev/url/gitbook.gitbook.io/test-gitbook-open

[argos-ci]

The latest updates on your projects. Learn more about Argos notifications ↗︎

Build	Status	Details	Updated (UTC)
customers-v2 (Inspect)	👍 Changes approved	4 changed	Sep 5, 2025, 3:06 PM
v2-cloudflare (Inspect)	👍 Changes approved	2 changed	Sep 5, 2025, 3:11 PM
v2-vercel (Inspect)	👍 Changes approved	2 changed	Sep 5, 2025, 3:08 PM

[gregberge]

You created an infinite number of llms-full.txt with your system. Use a proper page number instead of using the number of pages to skip.

I think it would be great to add unit tests on that (the algo of generation only, not the API).