Skip to content
Discussion options

You must be logged in to vote

Ok, taking another look, it may be related to the legacy stream handler, which is still being used by Google (and currently, only by Google and maybe Assistants API).

When you use the Google endpoint directly (and not with agents or a badge i.e. only "Code Interpreter" right now), it is still using the legacy way of emitting stream events. I detail in the docs how Agents introduced a 95% drop in data transfer, and part of many reasons everything will transition to that framework:

Using an agent, the same generation will transfer about about 52 kb of data, a 95% reduction in data transfer, which is that much less of a load on the server and the user’s device.

source

We can see with Googl…

Replies: 4 comments 4 replies

Comment options

You must be logged in to vote
1 reply
@KiGamji
Comment options

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
3 replies
@danny-avila
Comment options

@AetherMagee
Comment options

@danny-avila
Comment options

Answer selected by AetherMagee
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
3 participants
Converted from issue

This discussion was converted from issue #7370 on May 14, 2025 14:13.