-
Notifications
You must be signed in to change notification settings - Fork 84
Integrates AI Resources Page plugin #1485
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
dawnkelly09
wants to merge
1
commit into
master
Choose a base branch
from
integrate-ai-resources-plugin
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,37 +1,4 @@ | ||
| --- | ||
| title: AI Resources | ||
| description: Download LLM-optimized files of the Polkadot documentation, including full content and category-specific resources for AI agents. | ||
| --- | ||
|
|
||
| # AI Resources | ||
|
|
||
| Polkadot provides files to make documentation content available in a structure optimized for use with large language models (LLMs) and AI tools. These resources help build AI assistants, power code search, or enable custom tooling trained on Polkadot’s documentation. | ||
|
|
||
| ## How to Use These Files | ||
|
|
||
| - **Quick navigation**: Use `llms.txt` to give models a high-level map of the site. | ||
| - **Lightweight context**: Use `site-index.json` for smaller context windows or when you only need targeted retrieval. | ||
| - **Full content**: Use `llms-full.jsonl` for large-context models or preparing data for RAG pipelines. | ||
| - **Focused bundles**: Use category files (e.g., `basics.md`, `parachains.md`) to limit content to a specific theme or task for more focused responses. | ||
|
|
||
| These AI-ready files do not include any persona or system prompts. They are purely informational and can be used without conflicting with your existing agent or tool prompting. | ||
|
|
||
| ## Access LLM Files | ||
|
|
||
| | Category | Description | File | Actions | | ||
| |----------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | ||
| | Index | Markdown URL index for documentation pages, links to essential repos, and additional resources in the llms.txt standard format. | <code style="white-space: nowrap;">llms.txt</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/llms.txt" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/llms.txt" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/llms.txt" data-filename="llms.txt" title="Download"} </div> | | ||
| | Site index (JSON) | Lightweight site index of JSON objects (one per page) with metadata and content previews. | <code style="white-space: nowrap;">site-index.json</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/site-index.json" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/site-index.json" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/site-index.json" data-filename="site-index.json" title="Download"} </div> | | ||
| | Full site contents (JSONL) | Full content of documentation site enhanced with metadata. | <code style="white-space: nowrap;">llms-full.jsonl</code> | <div class="actions"> [:octicons-copy-16:](){ .llms-copy data-path="/ai/llms-full.jsonl" title="Copy" } [:octicons-download-16:](){ .llms-dl data-path="/ai/llms-full.jsonl" data-filename="llms-full.jsonl" title="Download" } </div> | | ||
| | Basics | Polkadot general knowledge base to provide context around overview and beginner-level content. | <code style="white-space: nowrap;">basics.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/basics.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/basics.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/basics.md" data-filename="basics.md" title="Download"} </div> | | ||
| | Reference | Reference material including key functions and glossary. | <code style="white-space: nowrap;">reference.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/reference.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/reference.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/reference.md" data-filename="reference.md" title="Download"} </div> | | ||
| | Smart Contracts | How to develop and deploy Solidity smart contracts on Polkadot Hub. | <code style="white-space: nowrap;">smart-contracts.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/smart-contracts.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/smart-contracts.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/smart-contracts.md" data-filename="smart-contracts.md" title="Download"} </div> | | ||
| | Parachains | How-to guides related to building, customizing, deploying, and maintaining a parachain. | <code style="white-space: nowrap;">parachains.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/parachains.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/parachains.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/parachains.md" data-filename="parachains.md" title="Download"} </div> | | ||
| | DApps | Information and tutorials for application developers. | <code style="white-space: nowrap;">dapps.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/dapps.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/dapps.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/dapps.md" data-filename="dapps.md" title="Download"} </div> | | ||
| | Networks | Information about the various Polkadot networks (Polkadot, Kusama, Westend, Paseo), their purposes, and how they fit into the development workflow. | <code style="white-space: nowrap;">networks.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/networks.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/networks.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/networks.md" data-filename="networks.md" title="Download"} </div> | | ||
| | Polkadot Protocol | Polkadot's core architecture, including the relay chain, parachains, system chains, interoperability, and main actors. | <code style="white-space: nowrap;">polkadot-protocol.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/polkadot-protocol.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/polkadot-protocol.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/polkadot-protocol.md" data-filename="polkadot-protocol.md" title="Download"} </div> | | ||
| | Infrastructure | Operational aspects of supporting the Polkadot network, including how to run a node or validator and staking mechanics. | <code style="white-space: nowrap;">infrastructure.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/infrastructure.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/infrastructure.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/infrastructure.md" data-filename="infrastructure.md" title="Download"} </div> | | ||
| | Tooling | An overview of various development tools available for Polkadot development. | <code style="white-space: nowrap;">tooling.md</code> | <div class="actions"> [:octicons-eye-16:](){ .llms-view data-path="/ai/categories/tooling.md" title="View"} [:octicons-copy-16:](){ .llms-copy data-path="/ai/categories/tooling.md" title="Copy"} [:octicons-download-16:](){ .llms-dl data-path="/ai/categories/tooling.md" data-filename="tooling.md" title="Download"} </div> | | ||
|
|
||
| !!! note | ||
| The `llms-full.jsonl` file may exceed the input limits of some language models due to its size. If you encounter limitations, consider using the smaller `site-index.json` or category bundle files instead. | ||
| --- | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ai-resources.mdnow contains only frontmatter, so the rendered “AI Resources” page will be blank unless the external MkDocs plugin injects content at build time. To avoid an empty page in local builds / previews (or if the plugin is disabled/misconfigured), add a minimal fallback body (e.g., a short note that the content is generated at build time and where to find the files) or include content via a snippet similar to other policy pages.There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@eshaben In local testing, the page generated by the plugin does overwrite any "fallback" content. If I remove the plugin from mkdocs.yml, it then displays the fallback content. Please confirm if we want to use a fallback page (I think yes but maybe you have a different idea for handling this). If we do want a fallback, what should be on that page? Thank you!