Processing Message History Event

[jiachengzz]

Question

Is there a way to get the event about message history is being processed by one of the history_processors? I'm trying to stream a message to the frontend saying "the agent is summarizing the chat history" prior to the LLM call. I couldn't figure out a cleaner approach, any suggestions would be really helpful!

Additional Context

No response

[DouweM]

@jiachengzz There's no native event for that, but you can relatively easily build your own event stream that combines events from coming from agent.iter or event_stream_handler, plus your own events that you can write directly from the history processor. See the example at #2382 (comment), that's specific to run_ag_ui but the idea should be clear. Let me know if you have trouble getting it to work.

[jiachengzz]

@DouweM Thank you so much for the suggestion, that idea worked. It seems that fastapi streaming solution has a minor issue where the StreamingResponse is being returned before the task has a chance to send any data, had to tweak it a little bit for the streaming to work, but it's able to send the event directly from a history processor. I'll post the working code there.

[github-actions]

This issue is stale, and will be closed in 3 days if no reply is received.

[github-actions]

Closing this issue as it has been inactive for 10 days.