OpenWebUI / ollama Error 500

[jsapede]

helle,
installed this morning this lxc including ollama but each time i try to make a test i get error 500 :

tried to change ip in the .env config like here tteck/Proxmox#3994 (comment) bit with no additionnal success

[jsapede]

moreover looks like in the new site there isnt anymore ollama install available ?

[MickLesk]

Can you open with your IP and the Port to Check ollama is working?

Can you share Output of systemctl Status?

@havardthom can you take a look?

[havardthom]

Check Ollama logs after trying the chat: journalctl -u ollama.service -n (in LXC console)

Do you have enough resources allocated to the LXC for the model you are trying? Could be out of memory error, check LXC resources while you try the chat

[jsapede]

tried with ollama separate install from exisiting script and seems to work
will retry with ollama install integrated to script

[jsapede]

reinstalled from zero and seems to work !
is there a way to have intel acceleration on this install script ?

[havardthom]

Hardware acceleration for Intel iGPU is currently not supported in Ollama, it will be after this PR is merged: ollama/ollama#5593

Hardware acceleration for Intel dGPU requires building Ollama from source code with intel-basekit and Intel drivers (this script covers it: https://github.com/community-scripts/ProxmoxVE/blob/main/install/ollama-install.sh)

Regardless, setting up Intel hardware acceleration currently takes too long for it to be user friendly, it would slow down the script install too much. Users that want it can set it up themselves until a more effective install method appears (hopefully Ollama will add support for it in their precompiled binary eventually)

[Solear]

I have the same error like the Threadstarter.

500: Ollama: 500, message='Internal Server Error', url='http://0.0.0.0:11434/api/chat'

Reinstalled it new with 8 GB and 6 cores, no luck.

[MickLesk]

try 127.0.0.1

[Solear]

127.0.0.0 and real IP doesnt work.
But I changed the model from llama3.2 to llama3.1, and now it works...

[MickLesk]

ive the same issue a few weeks ago. Ive removed all :D

[Vendo233]

I have the same error
500: Ollama: 500, message='Internal Server Error', url='http://0.0.0.0:11434/api/chat'
what can I do?

[Vendo233]

I have tried to reinstall, tried localhost, 127.0.0.1 and nothing helped