ollama support

[mio-19]

Problem Description

I would like to try to use self hosted llm to run this project

Proposed Solution

support ollama models

Alternative Solutions

No response

Additional Context

No response

[eDeveloperOZ]

How would love this too!
What kind of models do you think have good enough tool functions?

[mio-19]

How would love this too! What kind of models do you think have good enough tool functions?

I have no experience, but I have seen some Ollama models tuned for tool calling.
https://ollama.com/michaelneale/deepseek-r1-goose
https://ollama.com/ishumilin/deepseek-r1-coder-tools

[eDeveloperOZ]

This is great!
It might take me some time to get there myself but this is honestly great!
Thanks!

[Emasoft]

LM Studio too!
lmstudio-ai/lmstudio-bug-tracker#684