Skip to content

Commit 7591433

Browse files
committed
Add JUnit 5 ScorerExtension for AI model evaluation and associated library
- Implement `ScorerExtension` to inject and manage Scorer instances in tests. - Support field and parameter injection for Scorer using `@ScorerConfiguration`. - Add support for parameter injection of samples via `@SampleLocation` annotation. - Provide built-in evaluation strategies: - `SemanticSimilarityStrategy` (cosine similarity-based evaluation). - `AiJudgeStrategy` (AI-powered evaluation with customizable prompts). - Add tests for ScorerExtension: - Validate field and parameter injection of Scorer. - Test sample injection from YAML files. - Verify evaluation strategies and reporting. - Document ScorerExtension: - Explain concepts: Scorer, Samples, Evaluation Strategies, Reports. - Usage examples for field/parameter injection and evaluation. - Guide for using built-in strategies and creating custom strategies.
1 parent 6ec8ea5 commit 7591433

File tree

32 files changed

+2780
-0
lines changed

32 files changed

+2780
-0
lines changed

docs/modules/ROOT/nav.adoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@
88
** xref:prompt-generation.adoc[Prompt Generation]
99
** xref:guardrails.adoc[Guardrails]
1010
** xref:response-augmenter.adoc[Response Augmenter]
11+
** xref:testing.adoc[Testing]
1112
1213
* LLMs
1314
** xref:llms.adoc[LLMs]

0 commit comments

Comments
 (0)