Skip to content

Commit d89d76e

Browse files
author
潘婉宁
committed
feat: add chunk_include_usage option
1 parent 41b994b commit d89d76e

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

volcenginesdkarkruntime/types/chat/chat_completion_stream_options_param.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,3 +13,8 @@ class ChatCompletionStreamOptionsParam(TypedDict, total=False):
1313
request, and the `choices` field will always be an empty array. All other chunks
1414
will also include a `usage` field, but with a null value.
1515
"""
16+
17+
chunk_include_usage: bool
18+
"""if set, each data chunk will include a `usage` field
19+
representing the current cumulative token usage for the entire request.
20+
"""

0 commit comments

Comments
 (0)