Model outputs json instead of actually calling the tool, what is the reason? #8642
Unanswered
JoaoHCopetti
asked this question in
Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm using this model: https://ollama.com/library/qwen2.5-coder, 7b version.
But when I ask something it outputs a json instead of actually performing the task:
It calls the correct function, but doesn't perform anything.
Is it because the model size being small? Or is it related to something else?
Using cloud models works fine tho.
Beta Was this translation helpful? Give feedback.
All reactions