Skip to content

Generate the queries based on the queries provided by the user #15

@nicolo-rinaldi

Description

@nicolo-rinaldi

Description

In the current implementation, there is a feature that could be further explored: the possibility of adding queries collected beforehand to our generated evaluation dataset. This is done by linking the configuration file from the dataset_generator module using a parameter called queries.

The idea

We want to take advantage of these collected queries even more! Suppose that these queries are collected from some possible users; then we can assume that the people using the search engine that is being evaluated behave similarly. How can we exploit this? The idea is to manage the prompt to force the LLM to generate queries similar to the collected ones.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions