What's Changed
- fix(docs): add missing line break so the step title and description a… by @nkch1k in #2391
- Migrate SummaryScore by @rhlbhatnagar in #2376
- feat: add metadata fields for synthetic data traceability by @dev-jonathan in #2389
- Migrate noise sensitivity by @rhlbhatnagar in #2379
- docs: quickstart guide with interactive LLM and project structure by @anistark in #2380
- Migrate Faithfullness by @rhlbhatnagar in #2384
- fix: docs for discrete, numeric and ranking using instructor by @anistark in #2397
- Migrate Answer Accuracy + Context Relevance by @rhlbhatnagar in #2390
- refactor: remove aspect critic and simple criteria metrics with discrete metric examples by @anistark in #2399
- Migrate Context Pricision with + without ref by @rhlbhatnagar in #2398
- docs: fix recall formula label in SQL metrics by @tysoncung in #2405
- chore: remove deprecated
ground_truthsby @anistark in #2402 - docs: Add documentation for metrics.collections API by @sanjeed5 in #2407
- Migrate factual correctness by @rhlbhatnagar in #2401
- refactor: remove redundant AnswerSimilarity from collections API in favor of SemanticSimilarity by @anistark in #2410
- docs: Update documentation structure to reflect experiments-first paradigm by @sanjeed5 in #2394
- Response Groundedness by @rhlbhatnagar in #2403
- fix: office hours link update by @anistark in #2415
- Refactor/removing deprecated by @anistark in #2412
- fix: handle
max_completeion_tokenserror for newer openai models by @anistark in #2413 - refactor: make embeddings optional in AnswerCorrectness when using pure factuality mode by @anistark in #2414
- Feat/migrate context recall by @jjmachan in #2372
- chore: update quickstart llm config by @anistark in #2417
New Contributors
- @nkch1k made their first contribution in #2391
- @dev-jonathan made their first contribution in #2389
- @tysoncung made their first contribution in #2405
Full Changelog: v0.3.8...v0.3.9