-
Notifications
You must be signed in to change notification settings - Fork 23
Integrate StreamCallbacks.jl for streaming #72
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integrate StreamCallbacks.jl for streaming #72
Conversation
@roryl23 what do you think? |
@svilupp I'll take a look! Sorry about the delay |
I keep getting
even when I've added changes to override the |
I'll look at it tonight. It basically says that the response from the server is not SSE/not parseable, so I rather fail. It's usually driven by:
I'm not sure why all tests passed fine for me and not for you though. EDIT: Now I see that the error message explains that at the bottom -- I added that because it was a common error. |
Co-authored-by: roryl23 <[email protected]>
Thanks, but gpt-5-mini supports streaming without a problem -> Is there something special about your API key / OpenAI org? For debugging, the callbacks have a parameter Can you perhaps try again if it was an OpenAI glitch? |
Closes #65
This PR:
configure_callback!
helper and extendcreate_chat
to support custom providers and StreamCallbacksOther minor things:
Tests pass and examples execute as expected.