- Ollama installed on your system
- Pull the required model from ollama using the command
ollama pull <model_name>
- Make a virtualenv after cloning the repository (python3.10 or higher)
- Install the required libraries using
pip install -r requirements.txt - Start serving the app using command specified in run.sh using the command
source run.sh