Chat Ollama Provider plugin for LLM Workflow Engine
Access to Ollama chat models.
Follow the installation instructions for Ollama, and make sure the server is running on port 11434
.
Install the latest version of this software directly from github with pip:
pip install git+https://github.com/llm-workflow-engine/lwe-plugin-provider-chat-ollama
Install the latest version of this software directly from git:
git clone https://github.com/llm-workflow-engine/lwe-plugin-provider-chat-ollama.git
Install the development package:
cd lwe-plugin-provider-chat-ollama
pip install -e .
Add the following to config.yaml
in your profile:
plugins:
enabled:
- provider_chat_ollama
# Any other plugins you want enabled...
From a running LWE shell:
/provider chat_ollama
/model model llama2