You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/cody/enterprise/model-config-examples.mdx
+9-8Lines changed: 9 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -272,7 +272,7 @@ In the configuration above,
272
272
"status": "stable",
273
273
"contextWindow": {
274
274
"maxInputTokens": 45000,
275
-
"maxOutputTokens": 400
275
+
"maxOutputTokens": 4000
276
276
}
277
277
},
278
278
{
@@ -284,7 +284,7 @@ In the configuration above,
284
284
"status": "stable",
285
285
"contextWindow": {
286
286
"maxInputTokens": 7000,
287
-
"maxOutputTokens": 400
287
+
"maxOutputTokens": 4000
288
288
}
289
289
}
290
290
],
@@ -361,11 +361,12 @@ In the configuration above,
361
361
In the configuration above,
362
362
In the configuration above,
363
363
364
-
- Set up a provider override for Azure OpenAI, routing requests for this provider directly to the specified Azure OpenAI endpoint (bypassing Cody Gateway). **Note:** For Azure OpenAI, ensure that the `modelName` matches the name defined in your Azure portal configuration for the model.
365
-
- Add two OpenAI models:
366
-
- `"azure-openai::unknown::gpt-4o"` with "chat" capability - used for "chat" and "fastChat"
367
-
- `"azure-openai::unknown::gpt-35-turbo-instruct-test"` with "autocomplete" capability - used for "autocomplete"
368
-
- Since `"azure-openai::unknown::gpt-35-turbo-instruct-test"` is not supported on the newer OpenAI `"v1/chat/completions"` endpoint, we set `"useDeprecatedCompletionsAPI"` to `true` to route requests to the legacy `"v1/completions"` endpoint. This setting is unnecessary if you are using a model supported on the `"v1/chat/completions"` endpoint.
364
+
- Set up a provider override for Azure OpenAI, routing requests for this provider directly to the specified Azure OpenAI endpoint (bypassing Cody Gateway).
365
+
**Note:** For Azure OpenAI, ensure that the `modelName` matches the name defined in your Azure portal configuration for the model.
366
+
- Add two OpenAI models:
367
+
- `"azure-openai::unknown::gpt-4o"` with "chat" capability - used for "chat" and "fastChat"
368
+
- `"azure-openai::unknown::gpt-35-turbo-instruct-test"` with "autocomplete" capability - used for "autocomplete"
369
+
- Since `"azure-openai::unknown::gpt-35-turbo-instruct-test"` is not supported on the newer OpenAI `"v1/chat/completions"` endpoint, we set `"useDeprecatedCompletionsAPI"` to `true` to route requests to the legacy `"v1/completions"` endpoint. This setting is unnecessary if you are using a model supported on the `"v1/chat/completions"` endpoint.
0 commit comments