From 8b149a5b2da7c3af063e06a21726b243f60a9e68 Mon Sep 17 00:00:00 2001
From: Kevin Chen <3654603+chenkc805@users.noreply.github.com>
Date: Tue, 17 Sep 2024 21:50:02 -0400
Subject: [PATCH 1/2] Show Enterprise 3.5 Sonnet token limits
This was missing before.
Closes https://linear.app/sourcegraph/issue/CODY-3726/whats-our-token-limits-for-35-sonnet
---
docs/cody/core-concepts/token-limits.mdx | 26 +++++++++++++-----------
1 file changed, 14 insertions(+), 12 deletions(-)
diff --git a/docs/cody/core-concepts/token-limits.mdx b/docs/cody/core-concepts/token-limits.mdx
index d81961811..c3c2e8b1f 100644
--- a/docs/cody/core-concepts/token-limits.mdx
+++ b/docs/cody/core-concepts/token-limits.mdx
@@ -50,19 +50,21 @@ Here's a detailed breakdown of the token limits by model:
-| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
-| ------------------- | ------------------------ | --------------------- | ---------- |
-| gpt-3.5-turbo | 7,000 | shared | 1,000 |
-| gpt-4 | 7,000 | shared | 1,000 |
-| gpt-4-turbo | 7,000 | shared | 1,000 |
-| claude instant | 7,000 | shared | 1,000 |
-| claude-2.0 | 7,000 | shared | 1,000 |
-| claude-2.1 | 7,000 | shared | 1,000 |
-| claude-3 Haiku | 7,000 | shared | 1,000 |
-| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
-| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
-| mixtral 8x7b | 7,000 | shared | 1,000 |
+| **Model** | **Conversation Context** | **@-mention Context** | **Output** |
+| ------------------------ | ------------------------ | --------------------- | ---------- |
+| gpt-3.5-turbo | 7,000 | shared | 1,000 |
+| gpt-4 | 7,000 | shared | 1,000 |
+| gpt-4-turbo | 7,000 | shared | 1,000 |
+| claude instant | 7,000 | shared | 1,000 |
+| claude-2.0 | 7,000 | shared | 1,000 |
+| claude-2.1 | 7,000 | shared | 1,000 |
+| claude-3 Haiku | 7,000 | shared | 1,000 |
+| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
+| **claude-3.5 Sonnet^*^** | **15,000** | **30,000** | **4,000** |
+| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
+| mixtral 8x7b | 7,000 | shared | 1,000 |
+^*^*Shown are the standard limits. Exact token limits may vary depending on your deployment. Please contact your Sourcegraph representative to learn more.*
For more information on how Cody builds context, see our [documentation here](/cody/core-concepts/context).
From b17d67dbe5d36c73db2edd8094d750d713278a98 Mon Sep 17 00:00:00 2001
From: Aravind Ramaraju
Date: Wed, 18 Sep 2024 12:33:30 -0400
Subject: [PATCH 2/2] Updated the token limits for 3.5 Sonnet on Free and Pro
---
docs/cody/core-concepts/token-limits.mdx | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/cody/core-concepts/token-limits.mdx b/docs/cody/core-concepts/token-limits.mdx
index c3c2e8b1f..4e5d6732c 100644
--- a/docs/cody/core-concepts/token-limits.mdx
+++ b/docs/cody/core-concepts/token-limits.mdx
@@ -21,7 +21,7 @@ Here's a detailed breakdown of the token limits by model:
| claude-2.1 | 7,000 | shared | 4,000 |
| claude-3 Haiku | 7,000 | shared | 4,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
-| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
+| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
| mixtral 8x7B | 7,000 | shared | 4,000 |
| mixtral 8x22B | 7,000 | shared | 4,000 |
| Google Gemini 1.5 Flash | 7,000 | shared | 4,000 |
@@ -42,7 +42,7 @@ Here's a detailed breakdown of the token limits by model:
| claude-2.1 | 7,000 | shared | 4,000 |
| claude-3 Haiku | 7,000 | shared | 4,000 |
| **claude-3 Sonnet** | **15,000** | **30,000** | **4,000** |
-| **claude-3.5 Sonnet** | **15,000** | **45,000** | **4,000** |
+| **claude-3.5 Sonnet** | **15,000** | **30,000** | **4,000** |
| **claude-3 Opus** | **15,000** | **30,000** | **4,000** |
| **Google Gemini 1.5 Flash** | **15,000** | **30,000** | **4,000** |
| **Google Gemini 1.5 Pro** | **15,000** | **30,000** | **4,000** |