Skip to content

Commit 7a32bdc

Browse files
chenkc805aramaraju
andauthored
Show Enterprise 3.5 Sonnet token limits (#659)
This was missing before. Closes https://linear.app/sourcegraph/issue/CODY-3726/whats-our-token-limits-for-35-sonnet <!-- Explain the changes introduced in your PR --> ## Pull Request approval Although pull request approval is not enforced for this repository in order to reduce friction, merging without a review will generate a ticket for the docs team to review your changes. So if possible, have your pull request approved before merging. --------- Co-authored-by: Aravind Ramaraju <[email protected]>
1 parent 028b17d commit 7a32bdc

File tree

1 file changed

+16
-14
lines changed

1 file changed

+16
-14
lines changed

docs/cody/core-concepts/token-limits.mdx

Lines changed: 16 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ Here's a detailed breakdown of the token limits by model:
2121
| claude-2.1 | 7,000 | shared | 4,000 |
2222
| claude-3 Haiku | 7,000 | shared | 4,000 |
2323
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
24-
| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
24+
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
2525
| mixtral 8x7B | 7,000 | shared | 4,000 |
2626
| mixtral 8x22B | 7,000 | shared | 4,000 |
2727
| Google Gemini 1.5 Flash | 7,000 | shared | 4,000 |
@@ -42,27 +42,29 @@ Here's a detailed breakdown of the token limits by model:
4242
| claude-2.1 | 7,000 | shared | 4,000 |
4343
| claude-3 Haiku | 7,000 | shared | 4,000 |
4444
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
45-
| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
45+
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
4646
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
4747
| **Google Gemini 1.5 Flash** | **15,000** | **30,000** | **4,000** |
4848
| **Google Gemini 1.5 Pro** | **15,000** | **30,000** | **4,000** |
4949
| mixtral 8x7b | 7,000 | shared | 4,000 |
5050
</Tab>
5151

5252
<Tab title="Enterprise">
53-
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
54-
| ------------------- | ------------------------ | --------------------- | ---------- |
55-
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
56-
| gpt-4 | 7,000 | shared | 1,000 |
57-
| gpt-4-turbo | 7,000 | shared | 1,000 |
58-
| claude instant | 7,000 | shared | 1,000 |
59-
| claude-2.0 | 7,000 | shared | 1,000 |
60-
| claude-2.1 | 7,000 | shared | 1,000 |
61-
| claude-3 Haiku | 7,000 | shared | 1,000 |
62-
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
63-
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
64-
| mixtral 8x7b | 7,000 | shared | 1,000 |
53+
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
54+
| ------------------------ | ------------------------ | --------------------- | ---------- |
55+
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
56+
| gpt-4 | 7,000 | shared | 1,000 |
57+
| gpt-4-turbo | 7,000 | shared | 1,000 |
58+
| claude instant | 7,000 | shared | 1,000 |
59+
| claude-2.0 | 7,000 | shared | 1,000 |
60+
| claude-2.1 | 7,000 | shared | 1,000 |
61+
| claude-3 Haiku | 7,000 | shared | 1,000 |
62+
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
63+
| **claude-3.5 Sonnet^*^** | **15,000** | **30,000** | **4,000** |
64+
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
65+
| mixtral 8x7b | 7,000 | shared | 1,000 |
6566
</Tab>
67+
^*^*Shown are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative to learn more.*
6668
</Tabs>
6769

6870
For more information on how Cody builds context, see our [documentation here](/cody/core-concepts/context).

0 commit comments

Comments
 (0)