Using Phi3 with Langgraph, Multi agent framework

[hunaidkhan2000]

Checked other resources

• I added a very descriptive title to this issue.
• I searched the LangGraph/LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.
• I am sure that this is a bug in LangGraph/LangChain rather than my code.
• I am sure this is better as an issue rather than a GitHub discussion, since this is a LangGraph bug and not a design question.

Example Code

Na

Error Message and Stack Trace (if applicable)

No response

Description

Na

System Info

This issue is for a: (mark with an x)

• [x ] bug report -> please search issues before submitting
• [] feature request
• documentation issue or request
• regression (a behavior that used to work and stopped in a new release)
  Minimal steps to reproduce
  Using Phi 3 with Langgraph

Any log messages given by the failure
NA

Expected/desired behavior
Multi agent framework with routing

OS and Version?
Windows 10

Mention any other details that might be useful
I am trying to use Phi 3 mini 128 instruct with Langgraph for a multi-agent framework where it can route requests accurately. However, Phi 3 is not able to route the queries properly to a specific tool. Can anyone help? Does Phi 3 work with Langgraph, and does it support function calling or tool calling?

[gbaian10]

If you use Ollama, you can first check https://ollama.com/blog/tool-support to see if the model supports tool_call.
If it doesn't, it won't function properly.

[hunaidkhan2000]

Hi team, the Ollama website states that Mistral 7B Instruct v02 is not supported. However, when I use it with Langgraph and function calling, it works smoothly. But now, when I switch to Mistral 7B Instruct v03, the same code is not working with Langgraph. Any expert insights on this?

[vbarda]

Turning this into a discussion, as it's not an issue with langgraph