You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Remove incorrect BYOK claim (not available in Roo Code)
- Add default model information (anthropic/claude-sonnet-4)
- Document prompt caching feature for Claude and GPT models
- Add model capabilities section (vision and tool support)
- Improve pricing clarity with model dropdown tip
- Add security and troubleshooting notes
- Document default temperature setting (0.7)
- Note that only language models are displayed
- Include API endpoint for technical reference
Copy file name to clipboardExpand all lines: docs/providers/vercel-ai-gateway.md
+23-4Lines changed: 23 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,15 +27,28 @@ Useful links:
27
27
28
28
## Getting an API Key
29
29
30
-
1.**Sign Up/Sign In:** Go to the [Vercel Website](https://vercel.com/) and sign in Sign in.
30
+
An API key is required for authentication.
31
+
32
+
1.**Sign Up/Sign In:** Go to the [Vercel Website](https://vercel.com/) and sign in.
31
33
2.**Get an API Key:** Go to the [API Key page](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%2Fapi-keys&title=AI+Gateway+API+Key) in the AI Gateway tab. Create a new key.
32
34
3.**Copy the Key:** Copy the API key.
33
35
34
36
---
35
37
36
38
## Supported Models
37
39
38
-
the Vercel AI Gateway supports a large and growing number of models. Roo Code automatically fetches the list of available models. Refer to the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for the complete and up-to-date list.
40
+
The Vercel AI Gateway supports a large and growing number of models. Roo Code automatically fetches the list of available models from the `https://ai-gateway.vercel.sh/v1/models` endpoint. Only language models are shown.
41
+
42
+
The default model is `anthropic/claude-sonnet-4` if no model is selected.
43
+
44
+
Refer to the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for the complete and up-to-date list.
45
+
46
+
### Model Capabilities
47
+
48
+
-**Vision Support**: Many models support image inputs.
49
+
-**Tool/Computer Use**: Select models support function calling and computer use.
50
+
51
+
Check the model description in the dropdown for specific capabilities.
39
52
40
53
---
41
54
@@ -48,9 +61,15 @@ the Vercel AI Gateway supports a large and growing number of models. Roo Code a
48
61
49
62
---
50
63
64
+
## Prompt Caching
65
+
Vercel AI Gateway supports automatic prompt caching for select models including Anthropic Claude and OpenAI GPT models. This reduces costs by caching frequently used prompts.
66
+
67
+
---
68
+
51
69
## Tips and Notes
52
70
53
-
***Model Selection:** OpenRouter offers a wide range of models. Experiment to find the best one for your needs.
54
-
***Pricing:** The Vercel AI Gateway charges based on the underlying model's pricing. See the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for details.
71
+
***Model Selection:** The Vercel AI Gateway offers a wide range of models. Experiment to find the best one for your needs.
72
+
***Pricing:** The Vercel AI Gateway charges based on the underlying model's pricing, including costs for cached prompts. See the [Vercel AI Gateway Models page](https://vercel.com/ai-gateway/models) for details.
73
+
***Temperature:** The default temperature is `0.7` and is configurable per model.
55
74
***Bring Your Own Key (BYOK):** The Vercel AI Gateway has **no markup** if you decide to use your own key for the underlying service.
56
75
***More info:** Vercel does not add rate limits. Upstream providers may. New accounts receive $5 credits every 30 days until the first payment.
0 commit comments