Hosted LLM

[EduardDoronin]

I am hosting ChatbotUI on a Ubuntu Linux system and am trying to use the models that Ive installed on there from the outside but cant quite figure out how I should do that. Any ideas?

[EduardDoronin]

PS.: I can only use the models on the ubuntu linux system but not from anywhere else.

[EduardDoronin]

bump :p

[wrapss]

do you use ollama for your models?

[EduardDoronin]

yes, we fixed it though, turns out the routing on the nginx server was messed up

[MuhammedAYBU2020]

HELLO. I cannot communicate with local ollama models. The system gives a 404 response. How can I solve this problem?