Chat context/metadata in function calls

[Adversarian]

I'll try to ask my question with a scenario for my use-case:

Say I have a function reserve_room whose purpose is to fill-out a form through an API call and book a room in a hotel on a person's behalf. This tool is made available to a function-calling LLM with the intent of being able to reserve a hotel room in a chatbot. Now imagine that each registered user is assigned a user_id and attached to that user_id is that user's personal information (such as phone number, email, address, etc.). The API call that reserve_room has to make to actually reserve a room has many required fields (including the personal information attached to the user_id). Now, I do not want to explicitly ask for all of those required fields from the user, I want the function to be able to access that user's user_id without having to ask for the user to provide it to the LLM when they query the LLM on how to book a hotel room.

More succinctly, I would like to call a function reserve_room through my LLM and I want to be able to pass some form of context/metadata information which I don't want to have to explicitly ask the user for(i.e, including said metadata as arguments to the reserve_room function).

For instance, something like this (without the LLM asking for metadata from the user):

def reserve_room(metadata, specific_arg1, specific_arg2, ...):
    user_personal_info = API.get_user_personal_info(metadata.get("user_id")) # -> Dictionary containing kwargs to the next API call
    booking_id = API.book(specific_arg1, specific_arg2, ..., **user_personal_info)
    return {"booking_id": booking_id}

Instead of having to do this:

def reserve_room(personal_arg1, personal_arg2, ..., specific_arg1, specific_arg2, ...):
    booking_id = API.book(personal_arg1, personal_arg2, ..., specific_arg1, specific_arg2, ...)
    return {"booking_id": booking_id}

Is this possible using LlamaIndex (or at all)?

[dosubot[bot]]

Yes, in LlamaIndex, you can achieve this by using the Mem0Context class to associate a user_id with a function call without explicitly passing it as an argument. You can initialize a Mem0Context with a user_id and then use this context when creating a Mem0Memory instance. This context is used internally to include the user_id in function calls, allowing you to access user-specific data without explicitly asking the user for it.

Here's an example of how you can set this up:

from llama_index.memory.mem0.base import Mem0Context, Mem0Memory

# Create a context with a user_id
context = Mem0Context(user_id="your_user_id")

# Initialize Mem0Memory with the context
memory = Mem0Memory(context=context)

# Now, when you call methods like add or search, the user_id is automatically included
memory.add(messages="Your message here")

This setup allows you to pass user-specific metadata, like user_id, implicitly in your function calls ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[Adversarian]

The function that I need to call has to require user_id as an input but I don't want the user to be prompted to give their user_id when they ask how they can book a room. Does this fulfill that criteria?