Skip to content

Commit 2c30c16

Browse files
MaedahBatoolMaedahBatool
authored
Add new Sonnet 3.5 model to Token Limits page (#752)
Add new Sonnet 3.5 model to Token Limits page
1 parent 29faa2a commit 2c30c16

File tree

2 files changed

+32
-29
lines changed

2 files changed

+32
-29
lines changed

‎docs/cody/capabilities/supported-models.mdx‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@ Cody supports a variety of cutting-edge large language models for use in chat an
1515
| Anthropic | [claude-3 Haiku](https://docs.anthropic.com/claude/docs/models-overview#model-comparison) | ✅ | ✅ | ✅ | | | | |
1616
| Anthropic | [claude-3 Sonnet](https://docs.anthropic.com/claude/docs/models-overview#model-comparison) | ✅ | ✅ | ✅ | | | | |
1717
| Anthropic | [claude-3.5 Sonnet](https://docs.anthropic.com/claude/docs/models-overview#model-comparison) | ✅ | ✅ | ✅ | | | | |
18+
| Anthropic | [claude-3.5 Sonnet (New)](https://docs.anthropic.com/claude/docs/models-overview#model-comparison) | ✅ | ✅ | ✅ | | | | |
1819
| Anthropic | [claude-3 Opus](https://docs.anthropic.com/claude/docs/models-overview#model-comparison) | - | ✅ | ✅ | | | | |
1920
| Mistral | [mixtral 8x7b](https://mistral.ai/technology/#models:~:text=of%20use%20cases.-,Mixtral%208x7B,-Currently%20the%20best) | ✅ | ✅ | - | | | | |
2021
| Mistral | [mixtral 8x22b](https://mistral.ai/technology/#models:~:text=of%20use%20cases.-,Mixtral%208x7B,-Currently%20the%20best) | ✅ | ✅ | - | | | | |

‎docs/cody/core-concepts/token-limits.mdx‎

Lines changed: 31 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -12,20 +12,21 @@ Here's a detailed breakdown of the token limits by model:
1212

1313
<Tabs>
1414
<Tab title="Free">
15-
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
16-
| --------------------- | ------------------------ | --------------------- | ---------- |
17-
| gpt-3.5-turbo | 7,000 | shared | 4,000 |
18-
| gpt-4-turbo | 7,000 | shared | 4,000 |
19-
| gpt 4o | 7,000 | shared | 4,000 |
20-
| claude-2.0 | 7,000 | shared | 4,000 |
21-
| claude-2.1 | 7,000 | shared | 4,000 |
22-
| claude-3 Haiku | 7,000 | shared | 4,000 |
23-
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
24-
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
25-
| mixtral 8x7B | 7,000 | shared | 4,000 |
26-
| mixtral 8x22B | 7,000 | shared | 4,000 |
27-
| Google Gemini 1.5 Flash | 7,000 | shared | 4,000 |
28-
| Google Gemini 1.5 Pro | 7,000 | shared | 4,000 |
15+
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
16+
| --------------------------- | ------------------------ | --------------------- | ---------- |
17+
| gpt-3.5-turbo | 7,000 | shared | 4,000 |
18+
| gpt-4-turbo | 7,000 | shared | 4,000 |
19+
| gpt 4o | 7,000 | shared | 4,000 |
20+
| claude-2.0 | 7,000 | shared | 4,000 |
21+
| claude-2.1 | 7,000 | shared | 4,000 |
22+
| claude-3 Haiku | 7,000 | shared | 4,000 |
23+
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
24+
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
25+
| **claude-3.5 Sonnet (New)** | **15,000** | **30,000** | **4,000** |
26+
| mixtral 8x7B | 7,000 | shared | 4,000 |
27+
| mixtral 8x22B | 7,000 | shared | 4,000 |
28+
| Google Gemini 1.5 Flash | 7,000 | shared | 4,000 |
29+
| Google Gemini 1.5 Pro | 7,000 | shared | 4,000 |
2930

3031

3132

@@ -43,31 +44,32 @@ Here's a detailed breakdown of the token limits by model:
4344
| claude-3 Haiku | 7,000 | shared | 4,000 |
4445
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
4546
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
47+
| **claude-3.5 Sonnet (New)** | **15,000** | **30,000** | **4,000** |
4648
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
4749
| **Google Gemini 1.5 Flash** | **15,000** | **30,000** | **4,000** |
4850
| **Google Gemini 1.5 Pro** | **15,000** | **30,000** | **4,000** |
4951
| mixtral 8x7b | 7,000 | shared | 4,000 |
5052
</Tab>
5153

5254
<Tab title="Enterprise">
53-
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
54-
| ------------------------ | ------------------------ | --------------------- | ---------- |
55-
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
56-
| gpt-4 | 7,000 | shared | 1,000 |
57-
| gpt-4-turbo | 7,000 | shared | 1,000 |
58-
| claude instant | 7,000 | shared | 1,000 |
59-
| claude-2.0 | 7,000 | shared | 1,000 |
60-
| claude-2.1 | 7,000 | shared | 1,000 |
61-
| claude-3 Haiku | 7,000 | shared | 1,000 |
62-
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
63-
| **claude-3.5 Sonnet^*^** | **15,000** | **30,000** | **4,000** |
64-
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
65-
| mixtral 8x7b | 7,000 | shared | 1,000 |
55+
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
56+
| --------------------------- | ------------------------ | --------------------- | ---------- |
57+
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
58+
| gpt-4 | 7,000 | shared | 1,000 |
59+
| gpt-4-turbo | 7,000 | shared | 1,000 |
60+
| claude instant | 7,000 | shared | 1,000 |
61+
| claude-2.0 | 7,000 | shared | 1,000 |
62+
| claude-2.1 | 7,000 | shared | 1,000 |
63+
| claude-3 Haiku | 7,000 | shared | 1,000 |
64+
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
65+
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
66+
| **claude-3.5 Sonnet (New)** | **15,000** | **30,000** | **4,000** |
67+
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
68+
| mixtral 8x7b | 7,000 | shared | 1,000 |
6669
</Tab>
67-
^*^*Shown are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative to learn more.*
6870
</Tabs>
6971

70-
For more information on how Cody builds context, see our [documentation here](/cody/core-concepts/context).
72+
<Callout type="info">For Cody Enterprise, the token limits are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative. For more information on how Cody builds context, see our [docs here](/cody/core-concepts/context).</Callout>
7173

7274
## What is a Context Window?
7375

0 commit comments

Comments
 (0)