Skip to content

Show Enterprise 3.5 Sonnet token limits #659

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Sep 18, 2024
Merged

Show Enterprise 3.5 Sonnet token limits #659

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
8b149a5
Show Enterprise 3.5 Sonnet token limits
chenkc805 Sep 18, 2024
b17d67d
Updated the token limits for 3.5 Sonnet on Free and Pro
aramaraju Sep 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 16 additions & 14 deletions docs/cody/core-concepts/token-limits.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ Here's a detailed breakdown of the token limits by model:
| claude-2.1 | 7,000 | shared | 4,000 |
| claude-3 Haiku | 7,000 | shared | 4,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
| mixtral 8x7B | 7,000 | shared | 4,000 |
| mixtral 8x22B | 7,000 | shared | 4,000 |
| Google Gemini 1.5 Flash | 7,000 | shared | 4,000 |
Expand All @@ -42,27 +42,29 @@ Here's a detailed breakdown of the token limits by model:
| claude-2.1 | 7,000 | shared | 4,000 |
| claude-3 Haiku | 7,000 | shared | 4,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
| **Google Gemini 1.5 Flash** | **15,000** | **30,000** | **4,000** |
| **Google Gemini 1.5 Pro** | **15,000** | **30,000** | **4,000** |
| mixtral 8x7b | 7,000 | shared | 4,000 |
</Tab>

<Tab title="Enterprise">
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
| ------------------- | ------------------------ | --------------------- | ---------- |
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
| gpt-4 | 7,000 | shared | 1,000 |
| gpt-4-turbo | 7,000 | shared | 1,000 |
| claude instant | 7,000 | shared | 1,000 |
| claude-2.0 | 7,000 | shared | 1,000 |
| claude-2.1 | 7,000 | shared | 1,000 |
| claude-3 Haiku | 7,000 | shared | 1,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
| mixtral 8x7b | 7,000 | shared | 1,000 |
| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
| ------------------------ | ------------------------ | --------------------- | ---------- |
| gpt-3.5-turbo | 7,000 | shared | 1,000 |
| gpt-4 | 7,000 | shared | 1,000 |
| gpt-4-turbo | 7,000 | shared | 1,000 |
| claude instant | 7,000 | shared | 1,000 |
| claude-2.0 | 7,000 | shared | 1,000 |
| claude-2.1 | 7,000 | shared | 1,000 |
| claude-3 Haiku | 7,000 | shared | 1,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3.5 Sonnet^*^** | **15,000** | **30,000** | **4,000** |
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
| mixtral 8x7b | 7,000 | shared | 1,000 |
</Tab>
^*^*Shown are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative to learn more.*
</Tabs>

For more information on how Cody builds context, see our [documentation here](/cody/core-concepts/context).
Expand Down
Loading