Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
75 changes: 75 additions & 0 deletions docs/providers/vercel-ai-gateway.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
---
description: Configure the Vercel AI Gateway in Roo Code to robustly access 100+ language models from various providers through a centralized interface.
keywords:
- roo code
- vercel ai gateway
- ai provider
- language models
- api configuration
- model selection
- prompt caching
- usage tracking
- byok
sidebar_label: Vercel AI Gateway
image: /img/social-share.jpg
---

# Using Vercel AI Gateway With Roo Code

The AI Gateway provides a unified API to access hundreds of models through a single endpoint. It gives you the ability to set budgets, monitor usage, load-balance requests, and manage fallbacks.

Useful links:
- Team dashboard: https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai
- Models catalog: https://vercel.com/ai-gateway/models
- Docs: https://vercel.com/docs/ai-gateway

---

## Getting an API Key

An API key is required for authentication.

1. **Sign Up/Sign In:** Go to the [Vercel Website](https://vercel.com/) and sign in.
2. **Get an API Key:** Go to the [API Key page](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%2Fapi-keys&title=AI+Gateway+API+Key) in the AI Gateway tab. Create a new key.
3. **Copy the Key:** Copy the API key.

---

## Supported Models

The Vercel AI Gateway supports a large and growing number of models. Roo Code automatically fetches the list of available models from the `https://ai-gateway.vercel.sh/v1/models` endpoint. Only language models are shown.

The default model is `anthropic/claude-sonnet-4` if no model is selected.

Refer to the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for the complete and up-to-date list.

### Model Capabilities

- **Vision Support**: Many models support image inputs.
- **Tool/Computer Use**: Select models support function calling and computer use.

Check the model description in the dropdown for specific capabilities.

---

## Configuration in Roo Code

1. **Open Roo Code Settings:** Click the gear icon (<Codicon name="gear" />) in the Roo Code panel.
2. **Select Provider:** Choose "Vercel AI Gateway" from the "API Provider" dropdown.
3. **Enter API Key:** Paste your Vercel AI Gateway API key into the "Vercel AI Gateway API Key" field.
4. **Select Model:** Choose your desired model from the "Model" dropdown.

---

## Prompt Caching
Vercel AI Gateway supports automatic prompt caching for select models including Anthropic Claude and OpenAI GPT models. This reduces costs by caching frequently used prompts.

---

## Tips and Notes

* **Model Selection:** The Vercel AI Gateway offers a wide range of models. Experiment to find the best one for your needs.
* **Pricing:** The Vercel AI Gateway charges based on the underlying model's pricing, including costs for cached prompts. See the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for details.
* **Temperature:** The default temperature is `0.7` and is configurable per model.
* **Bring Your Own Key (BYOK):** The Vercel AI Gateway has **no markup** if you decide to use your own key for the underlying service.
* **More info:** Vercel does not add rate limits. Upstream providers may. New accounts receive $5 credits every 30 days until the first payment.
1 change: 1 addition & 0 deletions sidebars.ts
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,7 @@ const sidebars: SidebarsConfig = {
'providers/roo-code-cloud',
'providers/sambanova',
'providers/unbound',
'providers/vercel-ai-gateway',
'providers/vertex',
'providers/vscode-lm',
'providers/xai',
Expand Down