Ollama Tool Calling Feature

[briannezhad]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

Can Ollama tool calling be added? This would be very useful when building applications.

I have played around with langchain and see Ollama Functions. However, this doesn't do the job of calling a tool to factor in a response. I see in Ollama we have Mistral, which is one of those models supporting Tool ("Function") calling.

Is there a plan to support this feature for the Ollama Chat or Ollama Function Model?

Motivation

Tool calling for Ollama will allow any developer to factor in external data with Langchain capabilities + Open Source Models.

Proposal (If applicable)

No response

[Docteur-RS]

Actually langchain should support calling custom tools. But there is a bug in the @tool decorator that doesn't answer with a correctly formated JSON schema.
As show here.

I cannot find a way to get past this bug. And therefor cannot use langgraph with my ollama setup. :-(

[nikilpatel94]

How about this one? https://ollama.com/library/nexusraven
This is specifically fine tuned for tool calling.