Book-Talk

Chat with your books using local LLMs.

Get Started

• poetry install
• setup ollama
• poetry shell
• add epub files to the books directory
• chainlit run src/app.py

Runs on

• LLamaIndex for the RAG pipeline
• Ollama for running LLMs locally
• chainlit for the Chat UI
• sentence_transformers and langchain for creating embeddings

Todo

• persist index
• selectable profile for every epub
• support for german