-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Description
In the current implementation, there is a feature that could be further explored: the possibility of adding queries collected beforehand to our generated evaluation dataset. This is done by linking the configuration file from the dataset_generator module using a parameter called queries.
The idea
We want to take advantage of these collected queries even more! Suppose that these queries are collected from some possible users; then we can assume that the people using the search engine that is being evaluated behave similarly. How can we exploit this? The idea is to manage the prompt to force the LLM to generate queries similar to the collected ones.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request