Skip to content

Commit 1532a4a

Browse files
authored
Merge pull request #2 from amirbilu/usage-to-stream
Usage to stream
2 parents 207777f + a3a51af commit 1532a4a

File tree

2 files changed

+13
-0
lines changed

2 files changed

+13
-0
lines changed

.changeset/brown-meals-decide.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': minor
3+
---
4+
5+
Support usage metrics (e.g., totalTokens) in the Bedrock provider

src/handlers/bedrock.ts

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -549,7 +549,15 @@ async function* createCompletionResponseStreaming(
549549
created,
550550
model,
551551
object: 'chat.completion.chunk',
552+
...(stream.metadata?.usage && {
553+
usage: {
554+
prompt_tokens: stream.metadata.usage.inputTokens,
555+
completion_tokens: stream.metadata.usage.outputTokens,
556+
total_tokens: stream.metadata.usage.totalTokens,
557+
},
558+
}),
552559
}
560+
553561
yield convertedResponse
554562
}
555563
}

0 commit comments

Comments
 (0)