From e21909ec58a998c9f12f33ef7317edf2f1b1bf7d Mon Sep 17 00:00:00 2001 From: Maedah Batool Date: Wed, 28 May 2025 11:36:59 -0700 Subject: [PATCH] Cody model updates for 6.4 release --- docs/cody/capabilities/supported-models.mdx | 4 ++++ docs/cody/enterprise/model-configuration.mdx | 3 +++ 2 files changed, 7 insertions(+) diff --git a/docs/cody/capabilities/supported-models.mdx b/docs/cody/capabilities/supported-models.mdx index b543111e5..a508fbf77 100644 --- a/docs/cody/capabilities/supported-models.mdx +++ b/docs/cody/capabilities/supported-models.mdx @@ -41,6 +41,10 @@ In addition, Sourcegraph Enterprise customers using GCP Vertex (Google Cloud Pla Claude 3.7 Sonnet with thinking is not supported for BYOK deployments. +#### Claude 3.7 Sonnet and Claude 4 Sonnet for AWS Bedrock + +Cody's BYOK AWS Bedrock support can use Claude 3.7 Sonnet's **thinking mode**. Once enabled, Cody routes your prompts through Claude 3.7 Sonnet, using its expanded context window and advanced reasoning abilities to return noticeably smarter, more context-aware responses. + ## Autocomplete Cody uses a set of models for autocomplete which are suited for the low latency use case. diff --git a/docs/cody/enterprise/model-configuration.mdx b/docs/cody/enterprise/model-configuration.mdx index f37dfbd2a..0eaf04366 100644 --- a/docs/cody/enterprise/model-configuration.mdx +++ b/docs/cody/enterprise/model-configuration.mdx @@ -228,6 +228,9 @@ This field is an array of items, each with the following fields: - `reasoningEffort`: Specifies the effort on reasoning for reasoning models (having `reasoning` capability). Supported values: `high`, `medium`, `low`. How this value is treated depends on the specific provider. For example, for Anthropic models supporting thinking, `low` effort means that the minimum [`thinking.budget_tokens`](https://docs.anthropic.com/en/api/messages#body-thinking) value (1024) will be used. For other `reasoningEffort` values, the `contextWindow.maxOutputTokens / 2` value will be used. For OpenAI reasoning models, the `reasoningEffort` field value corresponds to the [`reasoning_effort`](https://platform.openai.com/docs/api-reference/chat/create#chat-create-reasoning_effort) request body value. + +If you are a Claude 3.0 user, you'll need to enable both the `reasoning` and `reasoningEffort` fields in order to get **thinking** support. + - `serverSideConfig`: Additional configuration for the model. It can be one of the following: - `awsBedrockProvisionedThroughput`: Specifies provisioned throughput settings for AWS Bedrock models with the following fields: