Skip to content

Commit daedb61

Browse files
committed
Update backfillSampling.ts
1 parent 904d036 commit daedb61

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

src/examples/backfill/backfillSampling.ts

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -260,6 +260,8 @@ export async function setupBackfill(client: NamedTransport, server: NamedTranspo
260260
: message.params.tools?.map(toolToClaudeFormat);
261261
const tool_choice = toolChoiceToClaudeFormat(message.params.toolChoice);
262262

263+
// TODO: switch to streaming if maxTokens is too large
264+
// "Streaming is required when max_tokens is greater than 21,333 tokens"
263265
const msg = await api.messages.create({
264266
model: pickModel(message.params.modelPreferences),
265267
system: message.params.systemPrompt === undefined ? undefined : [

0 commit comments

Comments
 (0)