Feature Request: Stop Streaming Response

[ckabalan]

One of our top requested features is to stop a streaming response mid-answer. Occasionally the user will see an answer is not going the right direction and want to cancel it. Today they either wait it out, or refresh the page (and we lose the chat history).

Is this something that would be difficult to add? Ideally we would cancel the response mid-stream and still finish the chat_history submission with the content so-far.

[taylorn-ai]

This has been raised a few times #1221, #1884 - there is some sample code on these you could try to integrate. @pamelafox - any thoughts on when something like this might be implemented?

[pamelafox]

I had a question on the open PR about it, but they didn't have time to address. I can try to take over that PR or re-make it. Here's the PR if anyone wants to start from there:
#1884