LibreChat update now gives invalid data structure to Azure Inception Jais (via LiteLLM). #8497
Replies: 3 comments 3 replies
-
I can swap back and forth between pre-June 16th versions of LibreChat where it works 100% of the time, and current versions of LibreChat break this 100% of the time. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Beta Was this translation helpful? Give feedback.
3 replies
-
Closed by #8502 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
We have been using the Inception Jais model (specializes in Arabic) from Azure, via LiteLLM.
https://azuremarketplace.microsoft.com/en/marketplace/apps/core42.core42-jais30b-v3-chat-offer
An update to LibreChat breaks all chat completions to this endpoint, with a 500 error coming from Azure Foundry.
The salient change(s) in LibreChat happened...
This is our LiteLLM configuration for Jais:
This is from our librechat.yaml for Jais:
This is the full log of the 500 error from Azure cloud logs:
LiteLLM reports this (ouch!)...I think that the core piece is
TypeError: unhashable type: 'dict'
, related todetect_language(msg["content"])
?Here is the full message received from Azure by LiteLLM:
LibreChat UI reports initial text, truncated:
Version Information
Erroring change to LibreChat occurred...
Steps to Reproduce
What browsers are you seeing the problem on?
Chrome
Relevant log output
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions