Skip to content

Commit 3296bd6

Browse files
committed
fix: only use the 20 percent if maxTokens is equal to contextWindow or if maxTokens is not provided
1 parent 0666cbd commit 3296bd6

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

webview-ui/src/utils/model-utils.ts

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,8 @@ export const calculateTokenDistribution = (
101101
// Get the actual max tokens value from the model
102102
// If maxTokens is valid, use it, otherwise reserve 20% of the context window as a default
103103
const defaultReserved = Math.ceil(safeContextWindow * 0.2)
104-
const reservedForOutput = maxTokens && maxTokens > 0 && maxTokens < defaultReserved ? maxTokens : defaultReserved
104+
const reservedForOutput =
105+
maxTokens && maxTokens > 0 && maxTokens === safeContextWindow ? defaultReserved : (maxTokens ?? defaultReserved)
105106

106107
// Calculate sizes directly without buffer display
107108
const availableSize = Math.max(0, safeContextWindow - safeContextTokens - reservedForOutput)

0 commit comments

Comments
 (0)