You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Why is the feature important for you?
I am doing some evals and using LLMContextRecall / other related MetrciWithLLM classes, they provide a default prompt which is convenient, but overriding the prompt is not so convenient. For example, ContextRecallClassificationPrompt is the prompt class used in LLMContextRecall, and its __init__ method does not allow changing the examples (because they are class attributes), so the only way to go around it is to subclass ContextRecallClassificationPrompt and change the examples, or to initialize an instance of ContextRecallClassificationPrompt and then setting the instruction/examples (prompt.examples = examples). Both are more verbose than I would expect, and feels like ragas is making things harder than necessary.