Tool Calling / Function Calling for ChatLlamaCpp

[raymon-io]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

ChatLlamaCpp does not support tool calling yet as it depends on node-llama-cpp where tool calling is not available in the stable version. However their beta version is available for some time and version 3.0 has tool calling functionality. ref 1 , ref 2

Proposal

My request is to support both version's of node-llama-cpp so that we could use tool calling functionality.

Motivation

Python version already has tool calling functionality.
Ref 1 (official documents)
Ref 2 (youtube video)

[raj-maharajwala]

Any Workaround solution to bind multiple tools to llm and auto detect tools or follow the workflow??
(pick more than on tool)

llm = ChatLlamaCpp(.........)

llm_with_tools = llm.bind_tools(
[list of all the tools tool 1, tool 2, tool 3],
tool_choice = ...........custom_work........)