ChatDocs: PrivateGPT + Web UI + GPU Support + More

[marella]

Hi,

I created this tool to chat with documents offline using LLMs: https://github.com/marella/chatdocs

It is based on PrivateGPT but has more features:

• Supports GGML models via C Transformers (another library made by me)
• Supports 🤗 Transformers models
• Supports GPTQ models
• Web UI
• GPU support
• Highly configurable via chatdocs.yml

It is easy to install and use:

pip install chatdocs              # Install
chatdocs download                 # Download models

chatdocs add /path/to/documents   # Add your documents
chatdocs ui                       # Start the web UI to chat with your documents

All the configuration options can be changed using a chatdocs.yml config file.

Please see README for more details.

[j-o-h-n-w-e-i-s]

Can this tool recurse documents located in nested folders?
I'm a teacher and would like to interrogate my lesson plans...Thanks!

[marella]

Yes, you can just add the top-level folder which contains the nested folders.

[Schippinski]

(chatdocs) C:\Users>chatdocs add Downloads\constitution.pdf
Creating new vectorstore
Loading documents from Downloads\constitution.pdf
Loading new documents: 0it [00:00, ?it/s]
No new documents to load

not finding documents for me, can anybody help?