chat persistence breaks and chat deletion not working offline

[weipienlee]

What happened?

using the app offline i.e. disconnected from network/internet. Although, chatting with a ollama model works, switching between chats and/or creating a new one shows no/wrong content. deleting a chat is not possible.

It all seems to recover in a while when network/internet connection is available again.

potential cause: chat title uses another llm, likely a cloud service version/openai, since it is not generated when off-line. Not sure why this would be related to deleting

Steps to Reproduce

1. Assure you have a local llm inference service
2. disconnect network/internet
3. create a chat/thread (simple, just a model without tools) => get answer, chat title remain "New Chat"
4. create a new chat => content in chat pane remains, but you can just chat
5. switch back to previous chat => no chat content visible
6. delete chat => chat

main commit: f0e8cca
docker install on macos

What browsers are you seeing the problem on?

Firefox

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

You can chat completely offline, I do it often.

Use this config for ollama

    - name: "Ollama"
      apiKey: "ollama"
      baseURL: "http://localhost:11434/v1/" # adjust as needed
# baseURL: "http://host.docker.internal:11434/v1/" # <-- usual value needed for docker
      models:
        default: [
          "llama3:latest",
          "command-r",
          "mixtral",
          "phi3",
          ]
        fetch: true
      dropParams: ["presence_penalty"]
      titleConvo: true
      titleModel: "current_model"

[weipienlee]

did that and cleared the cookies but no behaviour change. I think it's fair to assume that it is an auth problem for me. Will try re-install from scratch later.

Is this docker install guide still correct?

[fuegovic]

Is this docker install guide still correct?

yes this is correct

[weipienlee]

1. deleted all containers, images, and volumes
2. git clone https://github.com/danny-avila/LibreChat.git
3. cd LibreChat
4. cp .env.example .env and only filled in OPENAI_API_KEY
5. disconnect network and delete all cookies for http://localhost:3080
6. opened url in browser => get stuck before refresh
7. only after network connection the page continue to load

[weipienlee]

by the way, in any case, the login and new pages always show a 404 as shown above

[zakysyihan]

Hi guys I have pretty much the same problem with @weipienlee, is this problem solved or is there any solution already? @danny-avila

[the-vampiire]

i am wondering the same thing. while librechat doesnt specify that it works offline it is unexpected for it to have to reach out to external servers when i am (i believe) running the entire stack locally.

it gets stuck on initial load and stops here (with a pending load of silence.mp3...)?

as soon as i enable wifi it loads the rest:

i dont see anything in the compose logs that indicates what is happening

[the-vampiire]

FYI these were in incognito windows with cache disabled

[danny-avila]

I suspect the main issue is that the PWA service worker is getting stuck when offline. Web apps can be weird like that. This might help and will investigate soon: https://adueck.github.io/blog/caching-everything-for-totally-offline-pwa-vite-react/

[the-vampiire]

nice. i tried running everything locally so i could begin debugging. opened a PR yesterday to improve the issues associated with running the devcontainer. ill look into the offline bit this weekend

[weipienlee]

fyi: in my situation it keeps working if:

• I start with e.g. an ollama model
• then go offline
• stay on that thread => can keep chatting

not working:

• switch to another thread => thread (history) not loaded

still working:

• go back to initial thread => can continue chatting

funnier:

• stay on the other thread (non-initial)
• go online => thread (history) loads again
• go offline again
• all threads tried when offline but not went back when online again DO load
• all non-tried threads don't load off course

[danny-avila]

I tried some changes maybe they will help. I can run the app with my ethernet unplugged and windows on desktop mode.

[weipienlee]

will the thread in the history load when you switch without network? assuming they do not load from browser cache. i usually turn cache off for development. r, wp