Webserver for Alpaca

[CGTDWSU2054]

Is there a any project going on to run alpaca in a local server and remote access it through a web server?

[mags0ft]

Alpaca is a desktop application specifically meant to be used as such; there are no plans to make Alpaca usable in form of a web server that can be accessed remotely.

Note:

• there are projects that already do this, such as Open WebUI, which have the same set of features
• if you rather meant Ollama running remotely and a client (running Alpaca) accessing it, this is already supported; open the instance manager and add an Ollama instance, then fill out the fields

[Jeffser]

Believe it or not it isn't impossible to run Alpaca as a website

https://docs.gtk.org/gtk4/broadway.html

[Jeffser]

[mags0ft]

Okay, every time I thought I've seen it all, some even more cracked technology comes up and changes my mind 😵‍💫

[CGTDWSU2054]

Hello. Very nice tip, I will try that!

[CGTDWSU2054]

Thank you so much. That was Open WebUI that I was looking for. Good idea to run the instance remotely and alpaca locally. I think the advantage of using a web server is to have a universal client no matter the device you are using.

[Jeffser]

Do you mean the UI or the Ollama instance? if you want to run Ollama by itself you can do that

[CGTDWSU2054]

I mean the UI. I have a home server(Orange Pi 3B) and i would like to test a small image(Lhama3.2, phi3) running remotely and accessing through another client in the network)

[mags0ft]

Open WebUI is probably better in that case. It's designed to be used for exactly that use case.