[Enhancement]: Use simple text for title

[limdingwen]

What features would you like to see added?

(This was written from an Ollama user's perspective.)

LibreChat currently supports title generation using LLMs. However, some machines might not be beefy enough to run multiple LLMs (one for title generation), or the LLM currently used isn't fast enough for title generation.

Whatever the reason, it might be a good idea to provide a simple alternative to title generation: whatever the user inputted as the text! No LLMs, just truncation (character, word, or sentence). Easy on the machine, and better than a list of "New Chats".

IIRC, this is what OpenAI did when ChatGPT first came out.

More details

I was able to achieve this with this quick hack:

index 1bdf809d..03424bf6 100644
--- a/api/server/controllers/agents/client.js
+++ b/api/server/controllers/agents/client.js
@@ -996,6 +996,8 @@ class AgentClient extends BaseClient {
    * @param {string} params.conversationId
    */
   async titleConvo({ text, abortController }) {
+    return text.slice(0, 50);
+
     if (!this.run) {
       throw new Error('Run not initialized');
     }

Which components are impacted by your request?

API

Pictures

No response

Code of Conduct

[✓] I agree to follow this project's Code of Conduct