Add support for stream_usage in AzureChatOpenAI #28493
KeiKawashima-HEROZ
announced in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Checked
Feature request
AzureChatOpenAI does not support stream_usage, which is in ChatOpenAI.
Azure's API version
2024-10-21
now supports include_usage.See: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chatcompletionstreamoptions
Therefore, AzureChatOpenAI will also support stream_usage.
Motivation
I want to use
usage
from the API response.Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions