LibreChat, Agent Tools and LiteLLM don't seem to work

[Haherzke]

Hi, I'm using LiteLLM to access Azure OpenAI or Ollama with the OPENAI_REVERSE_PROXY env variable.
When using Agents to call a tool or action, the response of the used tool / action is never returned. Through the browser networking tab it seems the tool get's called with parameters, but a response never returns.
Visually it looks like this:

When not calling a tool or not using Agents, LiteLLM works as expected.

Tools/Actions work correctly when directly using Microsoft Azure without LiteLLM.

Any idea if this is caused by LibreChat or firewall problem on my side? Help gladly appreciated.

[danny-avila]

It seems like a LiteLLM issue, indeed it works well without it for both Azure and Ollama

[danny-avila]

Also worth trying LiteLLM as a "Custom Endpoint" instead of using the reverse proxy variable:

https://www.librechat.ai/docs/configuration/librechat_yaml/ai_endpoints/litellm
https://www.librechat.ai/docs/quick_start/custom_endpoints

[Haherzke]

As I wrote in #6556 this solves this problem for gpt-4o through litellm. It doesn't solve it for LLama3.3 through LiteLLM. It's not that important right now, but maybe I will look into this in the future.