Unable to bind tools with Chatollama

[shobhitagnihotri69]

I am trying to build agent with llama3.1 ,but I am unable to bind tools with llm

[dosubot[bot]]

To bind tools with ChatOllama when building an agent with llama3.1, you can use the @tool decorator on a normal Python function and then bind the tool to the ChatOllama instance. Here is an example:

from typing import List
from langchain_core.tools import tool
from langchain_ollama import ChatOllama

@tool
def validate_user(user_id: int, addresses: List[str]) -> bool:
    """Validate user using historical addresses.

    Args:
        user_id (int): the user ID.
        addresses (List[str]): Previous addresses as a list of strings.
    """
    return True

llm = ChatOllama(
    model="llama3.1",
    temperature=0,
).bind_tools([validate_user])

result = llm.invoke(
    "Could you validate user 123? They previously lived at "
    "123 Fake St in Boston MA and 234 Pretend Boulevard in "
    "Houston TX."
)
result.tool_calls

This code demonstrates how to create a tool using the @tool decorator and bind it to the ChatOllama instance. Note that the ChatLlamaCpp class from the langchain-community package also supports tool calling and can be used similarly. For more details, refer to the ChatLlamaCpp documentation ^[1][2][3][4].

To continue talking to Dosu, mention @dosu.