Skip to content

Commit 097bfc2

Browse files
committed
fix
1 parent 91da74b commit 097bfc2

File tree

1 file changed

+9
-8
lines changed

1 file changed

+9
-8
lines changed

docs/cody/enterprise/model-config-examples.mdx

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -272,7 +272,7 @@ In the configuration above,
272272
"status": "stable",
273273
"contextWindow": {
274274
"maxInputTokens": 45000,
275-
"maxOutputTokens": 400
275+
"maxOutputTokens": 4000
276276
}
277277
},
278278
{
@@ -284,7 +284,7 @@ In the configuration above,
284284
"status": "stable",
285285
"contextWindow": {
286286
"maxInputTokens": 7000,
287-
"maxOutputTokens": 400
287+
"maxOutputTokens": 4000
288288
}
289289
}
290290
],
@@ -361,11 +361,12 @@ In the configuration above,
361361
In the configuration above,
362362
In the configuration above,
363363

364-
- Set up a provider override for Azure OpenAI, routing requests for this provider directly to the specified Azure OpenAI endpoint (bypassing Cody Gateway). **Note:** For Azure OpenAI, ensure that the `modelName` matches the name defined in your Azure portal configuration for the model.
365-
- Add two OpenAI models:
366-
- `"azure-openai::unknown::gpt-4o"` with "chat" capability - used for "chat" and "fastChat"
367-
- `"azure-openai::unknown::gpt-35-turbo-instruct-test"` with "autocomplete" capability - used for "autocomplete"
368-
- Since `"azure-openai::unknown::gpt-35-turbo-instruct-test"` is not supported on the newer OpenAI `"v1/chat/completions"` endpoint, we set `"useDeprecatedCompletionsAPI"` to `true` to route requests to the legacy `"v1/completions"` endpoint. This setting is unnecessary if you are using a model supported on the `"v1/chat/completions"` endpoint.
364+
- Set up a provider override for Azure OpenAI, routing requests for this provider directly to the specified Azure OpenAI endpoint (bypassing Cody Gateway).
365+
**Note:** For Azure OpenAI, ensure that the `modelName` matches the name defined in your Azure portal configuration for the model.
366+
- Add two OpenAI models:
367+
- `"azure-openai::unknown::gpt-4o"` with "chat" capability - used for "chat" and "fastChat"
368+
- `"azure-openai::unknown::gpt-35-turbo-instruct-test"` with "autocomplete" capability - used for "autocomplete"
369+
- Since `"azure-openai::unknown::gpt-35-turbo-instruct-test"` is not supported on the newer OpenAI `"v1/chat/completions"` endpoint, we set `"useDeprecatedCompletionsAPI"` to `true` to route requests to the legacy `"v1/completions"` endpoint. This setting is unnecessary if you are using a model supported on the `"v1/chat/completions"` endpoint.
369370

370371
</Accordion>
371372

@@ -545,7 +546,7 @@ In the configuration above,
545546
"status": "stable",
546547
"contextWindow": {
547548
"maxInputTokens": 45000,
548-
"maxOutputTokens": 400
549+
"maxOutputTokens": 4000
549550
}
550551
}
551552
],

0 commit comments

Comments
 (0)