[AI Gateway] Restructure AI Gateway Docs + Add new features (#24499)

* feat: dynamic routing + byok drafts

* [AI Gateway] Restructure sidebar and add new features

* fix a few broken links and content

* reorder the sidebar

* feat: improve byok, dynamic routing docs

* fix: build, remove unused files

* fix: broken links

* feat: improve aig getting started, fix redirects

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/usage.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/json-configuration.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/index.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/json-configuration.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/features/dynamic-routing/json-configuration.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/configuration/bring-your-own-keys.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/configuration/bring-your-own-keys.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/configuration/bring-your-own-keys.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/configuration/bring-your-own-keys.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/configuration/bring-your-own-keys.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/get-started.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/get-started.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/get-started.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/get-started.mdx

Co-authored-by: Jun Lee <[email protected]>

* Update src/content/docs/ai-gateway/get-started.mdx

Co-authored-by: Jun Lee <[email protected]>

---------

Co-authored-by: Tarush <[email protected]>
Co-authored-by: Palash Golecha <[email protected]>
Co-authored-by: Palash <[email protected]>
Co-authored-by: Jun Lee <[email protected]>

Author: 4 people

public/__redirects

@@ -163,11 +163,14 @@
 /ai-gateway/integration/vercel-ai-sdk/ /ai-gateway/integrations/vercel-ai-sdk/ 301
 /ai-gateway/integration/aig-workers-ai-binding/ /ai-gateway/integrations/aig-workers-ai-binding/ 301
 /ai-gateway/integration/ /ai-gateway/integrations/ 301
-/ai-gateway/providers/open-router/ /ai-gateway/providers/openrouter/ 301
-/ai-gateway/providers/universal/ /ai-gateway/universal/ 301
-/ai-gateway/configuration/websockets-api/ /ai-gateway/websockets-api/ 301
-/ai-gateway/configuration/websockets-api/non-realtime-api/ /ai-gateway/websockets-api/non-realtime-api/ 301
-/ai-gateway/configuration/websockets-api/realtime-api/ /ai-gateway/websockets-api/realtime-api/ 301
+/ai-gateway/providers/open-router/ /ai-gateway/usage/providers/openrouter/ 301
+/ai-gateway/providers/universal/ /ai-gateway/usage/universal/ 301
+/ai-gateway/configuration/websockets-api/ /ai-gateway/usage/websockets-api/ 301
+/ai-gateway/configuration/websockets-api/non-realtime-api/ /ai-gateway/usage/websockets-api/non-realtime-api/ 301
+/ai-gateway/configuration/websockets-api/realtime-api/ /ai-gateway/usage/websockets-api/realtime-api/ 301
+/ai-gateway/configuration/caching/ /ai-gateway/features/caching/ 301
+/ai-gateway/configuration/rate-limiting/ /ai-gateway/features/rate-limiting/ 301
+/ai-gateway/configuration/custom-metadata/ /ai-gateway/observability/custom-metadata/ 301
 
 # agents
 /agents/capabilities/mcp-server/ /agents/model-context-protocol/ 301
@@ -2347,6 +2350,11 @@
 # Calls
 /calls/* /realtime/:splat 301
 
+# AI Gateway
+/ai-gateway/providers/* /ai-gateway/usage/providers/:splat 301
+/ai-gateway/guardrails/* /ai-gateway/features/guardrails/:splat 301
+/ai-gateway/websockets-api/* /ai-gateway/usage/websockets-api/:splat 301
+
 # Realtime
 /realtime/limits /realtime/sfu/limits 302
 /realtime/sessions-tracks /realtime/sfu/sessions-tracks/ 302
@@ -2362,4 +2370,4 @@
 
 /realtime/realtimekit/get-started /realtime/realtimekit/getting-started/ 302
 /realtime/introduction /realtime/realtimekit/introduction 302
-/realtime/concepts /realtime/realtimekit/concepts 302
+/realtime/concepts /realtime/realtimekit/concepts 302

src/assets/images/ai-gateway/dynamic-routing.png

@@ -6,7 +6,7 @@ products:
 date: 2025-01-02
 ---
 
-[**AI Gateway**](/ai-gateway/) now supports [**DeepSeek**](/ai-gateway/providers/deepseek/), including their cutting-edge DeepSeek-V3 model. With this addition, you have even more flexibility to manage and optimize your AI workloads using AI Gateway. Whether you're leveraging DeepSeek or other providers, like OpenAI, Anthropic, or [Workers AI](/workers-ai/), AI Gateway empowers you to:
+[**AI Gateway**](/ai-gateway/) now supports [**DeepSeek**](/ai-gateway/usage/providers/deepseek/), including their cutting-edge DeepSeek-V3 model. With this addition, you have even more flexibility to manage and optimize your AI workloads using AI Gateway. Whether you're leveraging DeepSeek or other providers, like OpenAI, Anthropic, or [Workers AI](/workers-ai/), AI Gateway empowers you to:
 
 - **Monitor**: Gain actionable insights with analytics and logs.
 - **Control**: Implement caching, rate limiting, and fallbacks.
@@ -31,4 +31,4 @@ curl https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/deepseek/cha
 }'
 ```
 
-For detailed setup instructions, see our [DeepSeek provider documentation](/ai-gateway/providers/deepseek/).
+For detailed setup instructions, see our [DeepSeek provider documentation](/ai-gateway/usage/providers/deepseek/).

src/content/changelog/ai-gateway/2025-01-07-aig-provider-deepseek.mdx

@@ -16,7 +16,7 @@ With the new AI Gateway binding methods, you can now:
 
 - Send feedback and update metadata with `patchLog`.
 - Retrieve detailed log information using `getLog`.
-- Execute [universal requests](/ai-gateway/universal/) to any AI Gateway provider with `run`.
+- Execute [universal requests](/ai-gateway/usage/universal/) to any AI Gateway provider with `run`.
 
 For example, to send feedback and update metadata using `patchLog`:
 

src/content/changelog/ai-gateway/2025-01-26-worker-binding-methods.mdx

@@ -6,15 +6,15 @@ products:
 date: 2025-02-05
 ---
 
-[AI Gateway](/ai-gateway/) has added three new providers: [Cartesia](/ai-gateway/providers/cartesia/), [Cerebras](/ai-gateway/providers/cerebras/), and [ElevenLabs](/ai-gateway/providers/elevenlabs/), giving you more even more options for providers you can use through AI Gateway. Here's a brief overview of each:
+[AI Gateway](/ai-gateway/) has added three new providers: [Cartesia](/ai-gateway/usage/providers/cartesia/), [Cerebras](/ai-gateway/usage/providers/cerebras/), and [ElevenLabs](/ai-gateway/usage/providers/elevenlabs/), giving you more even more options for providers you can use through AI Gateway. Here's a brief overview of each:
 
-- [Cartesia](/ai-gateway/providers/cartesia/) provides text-to-speech models that produce natural-sounding speech with low latency.
-- [Cerebras](/ai-gateway/providers/cerebras/) delivers low-latency AI inference to Meta's Llama 3.1 8B and Llama 3.3 70B models.
-- [ElevenLabs](/ai-gateway/providers/elevenlabs/) offers text-to-speech models with human-like voices in 32 languages.
+- [Cartesia](/ai-gateway/usage/providers/cartesia/) provides text-to-speech models that produce natural-sounding speech with low latency.
+- [Cerebras](/ai-gateway/usage/providers/cerebras/) delivers low-latency AI inference to Meta's Llama 3.1 8B and Llama 3.3 70B models.
+- [ElevenLabs](/ai-gateway/usage/providers/elevenlabs/) offers text-to-speech models with human-like voices in 32 languages.
 
 ![Example of Cerebras log in AI Gateway](~/assets/images/ai-gateway/cerebras2.png)
 
-To get started with AI Gateway, just update the base URL. Here's how you can send a request to [Cerebras](/ai-gateway/providers/cerebras/) using cURL:
+To get started with AI Gateway, just update the base URL. Here's how you can send a request to [Cerebras](/ai-gateway/usage/providers/cerebras/) using cURL:
 
 ```bash title="Example fetch request"
 curl -X POST https://gateway.ai.cloudflare.com/v1/ACCOUNT_TAG/GATEWAY/cerebras/chat/completions \

src/content/changelog/ai-gateway/2025-02-04-aig-provider-cartesia-eleven-cerebras.mdx

@@ -8,7 +8,7 @@ date: 2025-02-06
 
 AI Gateway adds additional ways to handle requests - [Request Timeouts](/ai-gateway/configuration/request-handling/#request-timeouts) and [Request Retries](/ai-gateway/configuration/request-handling/#request-retries), making it easier to keep your applications responsive and reliable.
 
-Timeouts and retries can be used on both the [Universal Endpoint](/ai-gateway/universal/) or directly to a [supported provider](/ai-gateway/providers/).
+Timeouts and retries can be used on both the [Universal Endpoint](/ai-gateway/usage/universal/) or directly to a [supported provider](/ai-gateway/usage/providers/).
 
 **Request timeouts**
 A [request timeout](/ai-gateway/configuration/request-handling/#request-timeouts) allows you to trigger [fallbacks](/ai-gateway/configuration/fallbacks/) or a retry if a provider takes too long to respond.

src/content/changelog/ai-gateway/2025-02-05-aig-request-handling.mdx

@@ -5,7 +5,7 @@ date: 2025-02-26
 preview_image: ~/assets/images/changelog/ai-gateway/guardrails-social-preview.png
 ---
 
-[AI Gateway](/ai-gateway/) now includes [Guardrails](/ai-gateway/guardrails/), to help you monitor your AI apps for harmful or inappropriate content and deploy safely.
+[AI Gateway](/ai-gateway/) now includes [Guardrails](/ai-gateway/features/guardrails/), to help you monitor your AI apps for harmful or inappropriate content and deploy safely.
 
 Within the AI Gateway settings, you can configure:
 
@@ -15,4 +15,4 @@ Within the AI Gateway settings, you can configure:
 
 ![Guardrails in AI Gateway](~/assets/images/ai-gateway/Guardrails.png)
 
-Learn more in the [blog](https://blog.cloudflare.com/guardrails-in-ai-gateway/) or our [documentation](/ai-gateway/guardrails/).
+Learn more in the [blog](https://blog.cloudflare.com/guardrails-in-ai-gateway/) or our [documentation](/ai-gateway/features/guardrails/).

src/content/changelog/ai-gateway/2025-02-26-guardrails.mdx

@@ -4,7 +4,7 @@ description: AI Gateway now supports end-to-end, client-to-provider WebSockets
 date: 2025-03-21
 ---
 
-We are excited to announce that [AI Gateway](/ai-gateway/) now supports real-time AI interactions with the new [Realtime WebSockets API](/ai-gateway/websockets-api/realtime-api/).
+We are excited to announce that [AI Gateway](/ai-gateway/) now supports real-time AI interactions with the new [Realtime WebSockets API](/ai-gateway/usage/websockets-api/realtime-api/).
 
 This new capability allows developers to establish persistent, low-latency connections between their applications and AI models, enabling natural, real-time conversational AI experiences, including speech-to-speech interactions.
 
@@ -36,4 +36,4 @@ ws.send(
 );
 ```
 
-Get started by checking out the [Realtime WebSockets API](/ai-gateway/websockets-api/realtime-api/) documentation.
+Get started by checking out the [Realtime WebSockets API](/ai-gateway/usage/websockets-api/realtime-api/) documentation.

src/content/changelog/ai-gateway/2025-03-20-websockets.mdx

@@ -6,7 +6,7 @@ products:
 date: 2025-06-03
 ---
 
-Users can now use an [OpenAI Compatible endpoint](/ai-gateway/chat-completion/) in AI Gateway to easily switch between providers, while keeping the exact same request and response formats. We're launching now with the chat completions endpoint, with the embeddings endpoint coming up next.
+Users can now use an [OpenAI Compatible endpoint](/ai-gateway/usage/chat-completion/) in AI Gateway to easily switch between providers, while keeping the exact same request and response formats. We're launching now with the chat completions endpoint, with the embeddings endpoint coming up next.
 
 To get started, use the OpenAI compatible chat completions endpoint URL with your own account id and gateway id and switch between providers by changing the `model` and `apiKey` parameters.
 
@@ -26,6 +26,6 @@ const response = await client.chat.completions.create({
 console.log(response.choices[0].message.content);
 ```
 
-Additionally, the [OpenAI Compatible endpoint](/ai-gateway/chat-completion/) can be combined with our [Universal Endpoint](/ai-gateway/universal/) to add fallbacks across multiple providers. That means AI Gateway will return every response in the same standardized format, no extra parsing logic required!
+Additionally, the [OpenAI Compatible endpoint](/ai-gateway/usage/chat-completion/) can be combined with our [Universal Endpoint](/ai-gateway/usage/universal/) to add fallbacks across multiple providers. That means AI Gateway will return every response in the same standardized format, no extra parsing logic required!
 
-Learn more in the [OpenAI Compatibility](/ai-gateway/chat-completion/) documentation.
+Learn more in the [OpenAI Compatibility](/ai-gateway/usage/chat-completion/) documentation.

src/content/changelog/ai-gateway/2025-06-03-aig-openai-compatible-endpoint.mdx

@@ -37,7 +37,7 @@ export default {
 		const client = new OpenAI({
 			apiKey: env.OPENAI_API_KEY,
 			// Optional: use AI Gateway to bring logs, evals & caching to your AI requests
-			// https://developers.cloudflare.com/ai-gateway/providers/openai/
+			// https://developers.cloudflare.com/ai-gateway/usage/providers/openai/
 			// baseUrl: "https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/openai"
 		});