On-Prem AI / Local Hosted Models

[Clankcoll]

Hi,

is there an way to implement local (HomeLab) hosted AI Models which are not public reachable.

I clicked fast through the extension setup but saw no way of using a Model hosted in my Own network (sometimes its hosted on the same host sometimes on a different but still same VLAN and IP range).

kind regards
-C

[adamhill]

We support full local LLM setup, pick OpenAI as the provider and put in the Base URL+port you would use to connect to it in other clients for chat.