Fuzzy Similarity Evalutator #41
Description
Fuzzy Similarity Evaluator
Description
vCache should support Fuzzy Similarity matchings to have another performant option to check whether the cached response matches the expected label (LLM) response.
Requirements
- Implement another strategy
- Use a performant C(++) library
- Pick a reasonable default threshold and allow the user to adjust it
Impact
- Who: End-users
- What: Latency and accuracy
- Why: More flexibility
Proposed Solution
See requirements
Acceptance Criteria
- Followed coding conventions
- Implemented or updated tests
Risks & Dependencies
Fuzzy matching might be unreliable.
Additional Context
--