What's the proper way to use ChatCompletion in stream mode? #464
Unanswered
DEAN-Cherry
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
According to the doc, it says you should use
CreateCompletionAsStream
to have streaming. However, there is a boolean property inChatCompletionCreateRequest
. I got confused that what is the proper way to use stream mode. There are 4 kinds of combination to use it, likeCreateCompletion
+Stream=true
andCreateCompletionAsStream
+Stream=ture
And I found that when uses
CreateCompletionAsStream
bothDelta.Content
andMessage.Content
are available. What's the different? And which should be used in stream mode?support content
The definition of

ChatCompletionCreateRequest
I also find this definition in

ChatChoiceResponse
. So dose it mean we can use whateverDelta
orMessage
in code?Beta Was this translation helpful? Give feedback.
All reactions