This repo is a working repository for developing and building on llama.cpp in Docker
The image is a ubuntu image that contains
- python
- ttyd
- node
- R
- llama.cpp repo (no model binaries included)
- misc bash scripts
If you create a models folder in llama.cpp and start up the Docker service, it will start an API server for you to talk to Llama2 via llama.cpp/examples/server
The Docker compose build starts up a ttyd service, llama.cpp API, and an rshiny app
app.R
wordcloud.R
