Connecting to custom endpoint (LiteLLM) via plugins fails with 401 error

[sanjeevkumarraob]

Hi All,

I am using LiteLLM as a proxy to connect to Claude AI in AWS Bedrock. I have a custom secure tool to connect to other apps in my company. Earlier we were using 0.7.4 version of librechat and now we are in the upgrade process. I have seen the direct bedrock connectivity and litellm as endpoints, but i dont want to use that way. I want to go through the tool first and then if the request needs more info, then it will connect to proxy and get the data.

With the new langchain/openai package versions, this is not working and i tried to add the base url as per https://python.langchain.com/api_reference/openai/chat_models/langchain_openai.chat_models.base.ChatOpenAI.html#langchain_openai.chat_models.base.ChatOpenAI but still no use.

Have anyone tried this way or getting similar errors? how can i resolve this issue?

TIA