[Bug]: Chat tabs randomly showing Russian

[jhmonroe]

What happened?

Hi @danny-avila this is a very strange bug or maybe not a bug...

While testing LibreChat with LM Studio Gemma 3 27B, the chat tab randomly changed from normal replies to this Russian text which when I ran thru Google Translate means "I plan to take my child to the zoo this year." which has nothing to do with what I'm chatting about except one chat had generated an ASCII art image of a figure standing on top of a cage with a cat in it so perhaps LibreChat interpreted this way but not sure why it switched to Russian since all my chats are in English.

Where does LibreChat generate the tab text from?

Other times the tab will default to "I'm sorry, but I cannot fulfill your request to write a story" when all I did was type test in the chat to see if the model was working. (and received a normal response acknowledging the test and it suggesting things it could do).

Curious how these previews are generated...

Version Information

ghcr.io/danny-avila/librechat-dev latest d8902f5bdbff 17 hours ago 1.6GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite latest 566585698235 5 days ago 1.8GB

Steps to Reproduce

1. have any chat
2. change topics at various points and sometimes the tab text changes

What browsers are you seeing the problem on?

No response

Relevant log output

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[KiGamji]

russian here, seems to be a huge hallucination, it is a thing due to the nature of small LLMs, and can be adjusted via temperature, not sure what temperature is set for title generation, but the prompt are hardcoded in the LibreChat project

[jhmonroe]

Very interesting! Thank you for the info/context of how it's generated. First time running local models (have used Librechat with paid APIs) and very excited at the possibilities

So in librechat.yaml if I changed

titleConvo: true
titleModel: 'gemma-3-27b-it'

to false... it would just stop adding titles

Temperature (in inference) in my local model is actually set to 0.1 out of 1 so it must just be hallucination caused by the ASCII

[KiGamji]

you may wanna try using zero temperature for title generation and even changing top p which is also a great way to prevent random nonsensical russian mass token probabilities. for example, 0.7 top p with 0.2 temperature

[jhmonroe]

you may wanna try using zero temperature for title generation and even changing top p which is also a great way to prevent random nonsensical russian mass token probabilities. for example, 0.7 top p with 0.2 temperature

@KiGamji thank you so much. this sounds great—agreed those titles don't need to be too colorful anyway.

I'm looking into the docs to see how to set this in librechat.yaml and not seeing here:

https://www.librechat.ai/docs/configuration/librechat_yaml/example

The only place I see temperature and top p mentioned are under dropParams in the example but I understand that's only to remove them from the call.

I'm not seeing anything in the Librechat docs about setting temperature just for title generation? I searched the docs for title, temperature, looked thru YAML examples for both and don't see a way to target this just for titles?

[KiGamji]

@danny-avila that would be a great feature to support