diff --git a/docs/cody/core-concepts/token-limits.mdx b/docs/cody/core-concepts/token-limits.mdx index d81961811..4e5d6732c 100644 --- a/docs/cody/core-concepts/token-limits.mdx +++ b/docs/cody/core-concepts/token-limits.mdx @@ -21,7 +21,7 @@ Here's a detailed breakdown of the token limits by model: | claude-2.1 | 7,000 | shared | 4,000 | | claude-3 Haiku | 7,000 | shared | 4,000 | | **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** | -| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** | +| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** | | mixtral 8x7B | 7,000 | shared | 4,000 | | mixtral 8x22B | 7,000 | shared | 4,000 | | Google Gemini 1.5 Flash | 7,000 | shared | 4,000 | @@ -42,7 +42,7 @@ Here's a detailed breakdown of the token limits by model: | claude-2.1 | 7,000 | shared | 4,000 | | claude-3 Haiku | 7,000 | shared | 4,000 | | **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** | -| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** | +| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** | | **claude-3 Opus** | **15,000** | **30,000** | **4,000** | | **Google Gemini 1.5 Flash** | **15,000** | **30,000** | **4,000** | | **Google Gemini 1.5 Pro** | **15,000** | **30,000** | **4,000** | @@ -50,19 +50,21 @@ Here's a detailed breakdown of the token limits by model: -| **Model** | **Conversation Context** | **@-mention Context** | **Output** | -| ------------------- | ------------------------ | --------------------- | ---------- | -| gpt-3.5-turbo | 7,000 | shared | 1,000 | -| gpt-4 | 7,000 | shared | 1,000 | -| gpt-4-turbo | 7,000 | shared | 1,000 | -| claude instant | 7,000 | shared | 1,000 | -| claude-2.0 | 7,000 | shared | 1,000 | -| claude-2.1 | 7,000 | shared | 1,000 | -| claude-3 Haiku | 7,000 | shared | 1,000 | -| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** | -| **claude-3 Opus** | **15,000** | **30,000** | **4,000** | -| mixtral 8x7b | 7,000 | shared | 1,000 | +| **Model** | **Conversation Context** | **@-mention Context** | **Output** | +| ------------------------ | ------------------------ | --------------------- | ---------- | +| gpt-3.5-turbo | 7,000 | shared | 1,000 | +| gpt-4 | 7,000 | shared | 1,000 | +| gpt-4-turbo | 7,000 | shared | 1,000 | +| claude instant | 7,000 | shared | 1,000 | +| claude-2.0 | 7,000 | shared | 1,000 | +| claude-2.1 | 7,000 | shared | 1,000 | +| claude-3 Haiku | 7,000 | shared | 1,000 | +| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** | +| **claude-3.5 Sonnet^*^** | **15,000** | **30,000** | **4,000** | +| **claude-3 Opus** | **15,000** | **30,000** | **4,000** | +| mixtral 8x7b | 7,000 | shared | 1,000 | +^*^*Shown are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative to learn more.* For more information on how Cody builds context, see our [documentation here](/cody/core-concepts/context).