README.md

fox-ood-llm

Large Language Model app for Open OnDemand. Runs Llama.cpp and connects to the bundled web UI.

Requires the ood-llm-aux repo to be installed.

Requires OOD version 3.1.0 or greater.