Skip to content

install.md

Latest commit

 

History

History
21 lines (21 loc) · 897 Bytes

install.md

File metadata and controls

21 lines (21 loc) · 897 Bytes

Install

Install with pip:

pip install dir-assistant

You can also install llama-cpp-python as an optional dependency to enable dir-assistant to directly run local LLMs:

pip install dir-assistant[recommended]

Note: llama-cpp-python is not updated often so may not run the latest models or have the latest features of Llama.cpp. You may have better results with a separate local LLM server and connect it to dir-assistant using the custom API server feature. The default configuration for dir-assistant is API-mode. If you download an LLM model with download-llm, local-mode will automatically be set. To change from API-mode to local-mode, set the ACTIVE_MODEL_IS_LOCAL setting.

For Ubuntu 24.04

pip3 has been replaced with pipx starting in Ubuntu 24.04.

pipx install dir-assistant