You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/providers/openai-compatible.md
+11-45Lines changed: 11 additions & 45 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,59 +16,25 @@ The key to using an OpenAI-compatible provider is to configure two main settings
16
16
2.**API Key:** This is the secret key you obtain from the provider.
17
17
3.**Model ID:** This is the model name of the specific model.
18
18
19
-
You'll find these settings in the Roo Code settings panel (click the gear icon ⚙️):
19
+
You'll find these settings in the Roo Code settings panel (click the <Codiconname="gear" /> icon):
20
20
21
21
***API Provider:** Select "OpenAI Compatible".
22
22
***Base URL:** Enter the base URL provided by your chosen provider. **This is crucial.**
23
23
***API Key:** Enter your API key.
24
-
***Model ID:** Enter the model ID that you have access to.
25
-
***Model Configuration:** The settings shown below will automatically be applied.
26
-
-**Max Output Tokens:** 4096
27
-
-**Context Window:** 8192
28
-
-**Supports prompt caching:** False
29
-
-**Supports images:** True
30
-
-**Input Price:** 0
31
-
-**Output Price:** 0
32
-
33
-
## Provider-Specific Instructions and Examples
34
-
35
-
Here are some examples of how to configure Roo Code for some popular OpenAI-compatible providers. **Always refer to your provider's documentation for the most up-to-date information.**
***API Key:** Obtain your API key from your [Perplexity account settings](https://www.perplexity.ai/).
41
-
***Base URL:**`https://api.perplexity.ai`
42
-
***Supported Models:** The models may vary, but some available models are: `pplx-7b-online`, `pplx-70b-online`, `pplx-7b-chat`, `pplx-70b-chat`, `mistral-7b-instruct`, `codellama-34b-instruct`, `codellama-70b-instruct`, `llama-2-70b-chat`.
***Supported Models:**[See the models list on the Anyscale Endpoints website.](https://docs.endpoints.anyscale.com/category/models)
57
-
58
-
### Using a Custom Provider
59
-
60
-
If your provider isn't listed above, you can still configure Roo Code to use it, as long as it offers an OpenAI-compatible API.
61
-
62
-
1.**Obtain the Base URL:** Find the API base URL in your provider's documentation. This is the URL you'll use to make API requests.
63
-
2.**Obtain an API Key:** Follow your provider's instructions for creating an API key.
64
-
3.**Find the Model ID:** Your provider will list the available model IDs.
65
-
4.**Enter the Information:** Enter the Base URL, API Key, and Model ID into the Roo Code settings.
24
+
***Model:** Chooose a model.
25
+
***Model Configuration:** This lets you customize advanced configuration for the model
26
+
- Max Output Tokens
27
+
- Context Window
28
+
- Image Support
29
+
- Computer Use
30
+
- Input Price
31
+
- Output Price
66
32
67
33
## Troubleshooting
68
34
69
35
***"Invalid API Key":** Double-check that you've entered the API key correctly.
70
36
***"Model Not Found":** Make sure you're using a valid model ID for your chosen provider.
71
37
***Connection Errors:** Verify the Base URL is correct and that your provider's API is accessible.
72
-
***Unexpected Results:** If you're getting unexpected results, try a different model or adjust the temperature setting.
38
+
***Unexpected Results:** If you're getting unexpected results, try a different model.
73
39
74
-
By using an OpenAI-compatible provider, you can leverage the flexibility of Roo Code with a wider range of AI models. Remember to always consult your provider's documentation for the most accurate and up-to-date information.
40
+
By using an OpenAI-compatible provider, you can leverage the flexibility of Roo Code with a wider range of AI models. Remember to always consult your provider's documentation for the most accurate and up-to-date information.
0 commit comments