Skip to content

Commit 4d9a4b3

Browse files
committed
Update Vercel AI Gateway documentation
- Remove incorrect BYOK claim (not available in Roo Code) - Add default model information (anthropic/claude-sonnet-4) - Document prompt caching feature for Claude and GPT models - Add model capabilities section (vision and tool support) - Improve pricing clarity with model dropdown tip - Add security and troubleshooting notes - Document default temperature setting (0.7) - Note that only language models are displayed - Include API endpoint for technical reference
1 parent dfbe7ce commit 4d9a4b3

File tree

1 file changed

+23
-4
lines changed

1 file changed

+23
-4
lines changed

docs/providers/vercel-ai-gateway.md

Lines changed: 23 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -27,15 +27,28 @@ Useful links:
2727

2828
## Getting an API Key
2929

30-
1. **Sign Up/Sign In:** Go to the [Vercel Website](https://vercel.com/) and sign in Sign in.
30+
An API key is required for authentication.
31+
32+
1. **Sign Up/Sign In:** Go to the [Vercel Website](https://vercel.com/) and sign in.
3133
2. **Get an API Key:** Go to the [API Key page](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%2Fapi-keys&title=AI+Gateway+API+Key) in the AI Gateway tab. Create a new key.
3234
3. **Copy the Key:** Copy the API key.
3335

3436
---
3537

3638
## Supported Models
3739

38-
the Vercel AI Gateway supports a large and growing number of models. Roo Code automatically fetches the list of available models. Refer to the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for the complete and up-to-date list.
40+
The Vercel AI Gateway supports a large and growing number of models. Roo Code automatically fetches the list of available models from the `https://ai-gateway.vercel.sh/v1/models` endpoint. Only language models are shown.
41+
42+
The default model is `anthropic/claude-sonnet-4` if no model is selected.
43+
44+
Refer to the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for the complete and up-to-date list.
45+
46+
### Model Capabilities
47+
48+
- **Vision Support**: Many models support image inputs.
49+
- **Tool/Computer Use**: Select models support function calling and computer use.
50+
51+
Check the model description in the dropdown for specific capabilities.
3952

4053
---
4154

@@ -48,9 +61,15 @@ the Vercel AI Gateway supports a large and growing number of models. Roo Code a
4861

4962
---
5063

64+
## Prompt Caching
65+
Vercel AI Gateway supports automatic prompt caching for select models including Anthropic Claude and OpenAI GPT models. This reduces costs by caching frequently used prompts.
66+
67+
---
68+
5169
## Tips and Notes
5270

53-
* **Model Selection:** OpenRouter offers a wide range of models. Experiment to find the best one for your needs.
54-
* **Pricing:** The Vercel AI Gateway charges based on the underlying model's pricing. See the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for details.
71+
* **Model Selection:** The Vercel AI Gateway offers a wide range of models. Experiment to find the best one for your needs.
72+
* **Pricing:** The Vercel AI Gateway charges based on the underlying model's pricing, including costs for cached prompts. See the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for details.
73+
* **Temperature:** The default temperature is `0.7` and is configurable per model.
5574
* **Bring Your Own Key (BYOK):** The Vercel AI Gateway has **no markup** if you decide to use your own key for the underlying service.
5675
* **More info:** Vercel does not add rate limits. Upstream providers may. New accounts receive $5 credits every 30 days until the first payment.

0 commit comments

Comments
 (0)