Setting number of nodes to be retrieved by chat engine

[sad-mathematician]

Hello!
How do we set the number of nodes to be retrieved by the chat engine? I am trying to add the nodes_k parameter to the as_chat_engine method
chat_engine = index.as_chat_engine(nodes_k = 10, ......)
but that doesn't seem to be making any difference in the number of nodes retrieved. Is there a different way to set this number of nodes parameter?

Seems to be a trivial thing but I am unable to figure this out. Any help will be appreciated.

[dosubot[bot]]

Hello, @sad-mathematician! 👋 I'm here to help you with any bugs, questions, or contributions you have while waiting for a human maintainer.

To set the number of nodes to be retrieved by the chat engine using the nodes_k parameter, you should pass the nodes_k parameter as part of the kwargs in the from_defaults method. Here is an example of how you can do it:

chat_engine = ContextChatEngine.from_defaults(
    retriever=my_retriever,
    service_context=my_service_context,
    chat_history=my_chat_history,
    memory=my_memory,
    system_prompt=my_system_prompt,
    prefix_messages=my_prefix_messages,
    node_postprocessors=my_node_postprocessors,
    context_template=my_context_template,
    llm=my_llm,
    nodes_k=10  # Set the number of nodes to be retrieved
)

In this example, nodes_k=10 sets the number of nodes to be retrieved to 10 ^[1].

Details

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[Sohum1]

similarity_top_k instead of nodes_k does the job.