v0.1.0rc1

What's Changed

• add initial embeddings.encode_kwargs by @lucasiscovici in #371
• feat(testset_generator): support error catching in generation process by @yuukidach in #368
• added class for FastEmbed by @tinomaxthayil in #379
• Updated NLI Verdicts to Binary Format by @lucasiscovici in #384
• added docs for ragas embeddings by @tinomaxthayil in #386
• fix context in _answer_correctness.py by @lucasiscovici in #385
• docs: AI copilot implementation by @nickscamara in #294
• fix: faithfulness for evasive/reject answers by @shahules786 in #392
• Added prompt class by @tinomaxthayil in #388
• Context precision with ground truth by @shahules786 in #391
• Added note to answer_relevance by @shahules786 in #399
• Import evaluate function before patching RagasLLM, fixes #301 by @HySoaKa in #377
• Fix: Added ground_truths arg type-hint info in the eval function by @MANISH007700 in #404
• Typo and phrasing correction by @TruscaPetre in #408
• Small improvements to documentation custom LLMs by @TruscaPetre in #410
• feat(metrics): skip embedding process when the corresponding weight is zero by @yuukidach in #409
• added prompt objects to metrics by @tinomaxthayil in #401
• feat: Automatic Prompt adaptation [language] by @shahules786 in #407
• Update _faithfulness.py by @Robs1999 in #416
• fix(metrics): avoid dividing by zero in correctness by @yuukidach in #421
• Feature/doc update ragas score by @prufrock349 in #417
• Docs: Prompts and prompt adaptation by @shahules786 in #419
• fix(metrics): wrong usage of prompt by @yuukidach in #422
• fix: context_utilization name override by @jjmachan in #424
• feat/executor: make ragas faster and more robust to run by @jjmachan in #390
• fix: Import PrompValue by @shahules786 in #427
• fix: add uuid to analytics by @shahules786 in #428
• feat: added async version for json_load by @jjmachan in #430
• fix: comment error in analytics by @jjmachan in #433
• fix: payload in analytics by @shahules786 in #434
• fix: tests for analytics by @jjmachan in #435
• Docs: tracing and logging by @shahules786 in #436
• feat: global prompt adaptation by @shahules786 in #432
• chore: remove mac artifacts from store by @jjmachan in #438
• fix: vary temperature based on strictness by @shahules786 in #437
• docs: custom llms by @shahules786 in #442
• feat: improving testset generation by @jjmachan in #381
• Fix: context_recall AttributeError by @0ENZO in #453
• Update faithfulness.md by @francesco-defalco in #451
• Fixing typo in faithfulness by @jamesbraza in #450
• fix: context_recall example by @shahules786 in #458
• fix: answer relevancy parsing by @shahules786 in #461
• feat: MVP for the new TestsetGenerator - SimpleEvolution by @jjmachan in #464
• fix: clean up embeddings for ragas and add docs for azure embeddings by @jjmachan in #477
• fix: polishing raise_exception and max_workers by @jjmachan in #486
• Convert prompts in testset generation by @shahules786 in #484
• feat(testset generation): implement new TestsetGenerator by @jjmachan in #487
• doc: add community page by @shahules786 in #488
• Fix ValueError: diag requires an array of at least two dimensions #474 by @herman159 in #475
• doc: modify prompt adaptation by @shahules786 in #490
• docs: theming community by @jjmachan in #491
• fix: CP example by @shahules786 in #489
• feat(testset): ported simple, multi_context and reasoning evolutions by @jjmachan in #496
• fix: cleanup old testset generator by @jjmachan in #500
• feat: added tracking of minimal stuff in testset generation by @jjmachan in #509
• feat: added generate_from_langchain function by @jjmachan in #511
• docs: updated testset generation by @shahules786 in #510
• fix: answer_correctness embedding by @jjmachan in #513

New Contributors

• @lucasiscovici made their first contribution in #371
• @nickscamara made their first contribution in #294
• @HySoaKa made their first contribution in #377
• @TruscaPetre made their first contribution in #408
• @Robs1999 made their first contribution in #416
• @prufrock349 made their first contribution in #417
• @0ENZO made their first contribution in #453
• @francesco-defalco made their first contribution in #451
• @jamesbraza made their first contribution in #450
• @herman159 made their first contribution in #475

Full Changelog: v0.0.22...v0.1.0rc1