How do I get "thought process" info while streaming? #727
Unanswered
richardtallent-erm
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have a streamed chat completion request using reasoning models. Sometimes it takes upwards of a few minutes of "thinking" before it starts streaming back its answer. I'd like to notify the user during that wait, and also maybe store the thought process so I can review it to improve my prompts.
I thought this information might be coming back as "reasoning content," but I added this code to my loop, and the
foreach
doesn't actually get any completions until it starts streaming back the final answer:Is there some other method or callback I can use to capture the pre-completion thoughts?
Beta Was this translation helpful? Give feedback.
All reactions