Skip to content

Latest commit

 

History

History
17 lines (12 loc) · 661 Bytes

README.md

File metadata and controls

17 lines (12 loc) · 661 Bytes

Generic Ollama Docker

This is a generic ollama docker that runs gemma3:4b. There are a few things that can be done to make this more general, but for now this is a barebones deployment. There is a python file with a REST API that coordinates user interaction and information preprocessing, a compose.yml file to set up an ollama image to talk to, and a Dockerfile that uses the uv toolsuite to manage the packages for the python REST API.

To spin up the containerized images

sudo docker compose --build

To chat from the cli

uv tool install md2term
PROMPT='Hello World'
curl -s http://127.0.0.1:5000/prompt/$PROMPT | uvx md2term -