Tools not called by qwen 2.5 and other models #133
Description
===== Problem =====
Ollama models like qwen 2.5 will not call any tools. They attempt to Think, but after thinking the processing just stops.
- Tried setting the "Thinking Mode" option results in Thinking mode is only available for models that have the 'thinking' capability.
- Have also tried debugging and it appers that no tool_calls are coming back from the model even though the thinking output mentions using the tool.
It seems like either we need better prompts to allow these qwen models to handle tool calling or we need some way to inspect the thiking process that can pull out the tools more reliably??
** Also tried qwen2.5-coder (instead of the cline fine-tuned model). It gives different output but also does not result in any tool calls
** Also tried adding a system prompt like:
When a tool call is required return the tool_call xml tag and place the tool call json in there
to the qwen2.5 model, that didn't change the output at all.
Not sure of next steps??
===== Environment =====
I'm using ollama version is 0.13.0 and the latest ollmcp version which is :
ollmcp --version
mcp-client-for-ollama 0.22.0
I'm configured to only use one mcp server now, the filesystem one as a docker container:
{
"mcpServers": {
"filesystem": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"-v",
"/datadrive/Vault:/local-directory",
"mcp/filesystem",
"/local-directory"
]
}
}
}