Performance issues in Firefox-based browsers #7371
-
Beta Was this translation helpful? Give feedback.
Replies: 4 comments 4 replies
-
Thank you for this detailed report about Firefox-specific streaming performance issues. Based on your observations, particularly:
This strongly suggests a potential memory leak in Firefox's handling of SSE (Server-Sent Events) streaming. This aligns with your observation that the issue occurs during streaming and appears related to the network layer. Recommended Next Steps:
While we investigate potential workarounds on our end, having this properly documented with Mozilla would be the most effective path forward for a proper fix, as this appears to be a browser-specific issue with how Firefox handles SSE connections. Would you be willing to submit this bug report to Mozilla and share the bug link here once created? |
Beta Was this translation helpful? Give feedback.
-
By the way, here's the screen cap of the issue in action: https://files.catbox.moe/a9377d.mp4 |
Beta Was this translation helpful? Give feedback.
-
@danny-avila After posting a report on Bugzilla, they seem to have confirmed that this is, in fact, an issue on LibreChat's side and not a Firefox bug. https://bugzilla.mozilla.org/show_bug.cgi?id=1966410 |
Beta Was this translation helpful? Give feedback.
-
After testing a bit more, the problem is indeed not present on Agents. The stream itself feels quite slower but that's probably just an issue in my testing env (I'm testing on another, weaker deployment since Agents are off on the main one) |
Beta Was this translation helpful? Give feedback.
Ok, taking another look, it may be related to the legacy stream handler, which is still being used by Google (and currently, only by Google and maybe Assistants API).
When you use the Google endpoint directly (and not with agents or a badge i.e. only "Code Interpreter" right now), it is still using the legacy way of emitting stream events. I detail in the docs how Agents introduced a 95% drop in data transfer, and part of many reasons everything will transition to that framework:
source
We can see with Googl…