Models seem to lose context mid discussion

[mauzilla]

Anyone else experience an issue where the model output seems to "freeze" and then when you either stop the response (or refresh), the model seems to lose previous context? I'm sure this is likely something on my side (maybe an incorrect setup), but it can get quite frustrating. It does not seem to be related to tokens, it happens at random (even with short discussions), and not all the time. I experienced it with both Gemini and GPT, any ideas?

[danny-avila]

I don't have this issue, what models and providers are you using? any prompts that make this happen consistently in your experience?

[mauzilla]

Hi @danny-avila , I am sure this is a "me" problem but can confirm it's happening with all the models (so not model specific, found it with both gemini and chatgpt). I am hosting in azure and I am sure I may have skipped a step. Everything works, chats show up, nothing looks "broken" but the AI chats seem to have no context. Even 2 messages after eachother points to the same "I dont remember / no context" - For what it's worth, I am sharing some console messages:

1. I have a recurring error: /api/mcp/connection/status:1 - this results in a 404 not found. It seems to be related to my MCP connection (which I will be honest I did not configure or left as default).
2. Parameters processed successfully - This I assume is as expected
3. I then get numerous "connection is opened" messages - Seems to coincide with the new chats. I am not sure if I should be getting a connection is opened for each responding message?
4. /api/convos/gen_title:1 - Also returns a 404 not found (This I can also confirm as the title seems to be stuck with "New Chat" in some cases
5. /api/convos:1 - This one gives me a 401 unauthorised - Refreshing token (could be normal)
6. Uncaught (in promise) non-precached-url: non-precached-url :: [{"url":"index.html"}] - workbox file

I am running the native docker install with an Apache based proxy - This is simply to setup a secure port (I restrict access to the site as I have other PHP based applications on the server so dont want to reuse 80/443)

Overall, WONDERFUL system, hope you can help me (and even scold me if my implimentation is invalid) - Let me know if there is anything else I can provide?

[danny-avila]

Just make sure you are logging out and logging back in. It could be that your session expired but somehow the proxy is preventing log out.