v0.7.1

What's Changed

• doc: fix error word in the context-conciseness.mdx by @zhaozhiming in #693
• Update location of zeno.ipynb by @emmanuel-ferdman in #696
• Dashboard: Find common topics by @Dominastorm in #695
• New evals by @ashish-1600 in #699
• Convert name to ids in url mapping by @sanchitadev in #700
• Add docstrings and comments to base.py by @Dominastorm in #701
• Add local evaluation support for 'exact' and 'rouge' methods in ResponseMatching by @Dominastorm in #702
• Allow using multiple Response Matching methods at once by @Dominastorm in #703
• Dashboard duplicate eval by @ashish-1600 in #704
• Support evaluation_name and project_name in Evalllamaindex by @Dominastorm in #705
• v0.7.1 by @Dominastorm in #706

New Contributors

• @zhaozhiming made their first contribution in #693
• @emmanuel-ferdman made their first contribution in #696

Full Changelog: v0.7.0...v0.7.1

v0.7.0

What's Changed

• Change default evaluation model to gpt-3.5-turbo by @Dominastorm in #685
• Link fixes in llamaindex by @shrjain1312 in #687
• frontend changes by @sanchitadev in #689
• update new APIs for new backend by @ashish-1600 in #688

Full Changelog: v0.6.13...v0.7.0

v0.6.13

What's Changed

• Add Multi-Query Accuracy docs and improve Sub-Query Completeness docs by @Dominastorm in #676
• Fix Guideline Adherence by @Dominastorm in #677
• Update Guideline Adherence Test by @Dominastorm in #678
• Api client modify by @ashish-1600 in #679
• update frontend code by @ashish-1600 in #680
• Embedding Operator Tutorial by @Dominastorm in #584
• add question_completeness eval by @ashish-1600 in #681
• Assistants Evaluation by @shrjain1312 in #675
• Improve Language critique operator by @Dominastorm in #683
• Update Response Matching Operator by @Dominastorm in #684

Full Changelog: v0.6.12...v0.6.13

v0.6.12

What's Changed

• Milvus Integration Cookbook by @shrjain1312 in #668
• Updated dashboard positioning in docs by @shrjain1312 in #669
• Add query rewrite operator by @ashish-1600 in #670
• Create MultiQueryAccuracy operator by @Dominastorm in #671
• Add open source prompt for query rewrite by @ashish-1600 in #672
• Add support for vllm by @Dominastorm in #673
• v0.6.12 by @Dominastorm in #674

Full Changelog: v0.6.10.post1...v0.6.12

v0.6.10.post1

What's Changed

• Add Custom Eval to docs by @Dominastorm in #662
• Remove TransformOp from Custom Evals by @Dominastorm in #663
• Promptfoo view function better handling by @shrjain1312 in #653
• Add links to llamaindex callback handler docs and Daily Monitoring to README by @Dominastorm in #664
• Add support for local evaluation in CustomPromptEval by @Dominastorm in #666
• Remove OpenAI API key requirement from custom evals by @Dominastorm in #665

Full Changelog: v0.6.9...v0.6.10.post1

v0.6.9

What's Changed

• Change json.loads to parse_json by @Dominastorm in #647
• Make output of response consistency consistent by @Dominastorm in #648
• Change demo video by @Dominastorm in #649
• Update pyproject.toml by @Dominastorm in #650
• Readme Changes: Buttons by @shrjain1312 in #651
• Custom python func by @sourabhagr in #655
• Add support for ColumnOp in EvalLLM by @Dominastorm in #657
• Added openai api key validation by @ashish-1600 in #659
• Add pandas data handling by @Dominastorm in #652
• Create Tutorial for Custom Eval by @Dominastorm in #658
• Add badges to README by @Dominastorm in #660
• Fixes: Factual Accuracy and Response Completeness Tests and Add json5 to dependencies by @Dominastorm in #661

Full Changelog: v0.6.8...v0.6.9

v0.6.8

What's Changed

• RCA tutorial improvements by @shrjain1312 in #608
• Integration to support ollama for evaluations by @shrjain1312 in #623
• Fix docs by @Dominastorm in #622
• added experiment on gemma vs gpt by @shrjain1312 in #618
• Ollama integration by @shrjain1312 in #626
• Cookbook for Helicone by @shrjain1312 in #625
• Update frontend code by @sanchitadev in #627
• Support CLASSIFY eval type for Response Consistency eval by @Abhiramkns in #583
• Update dependencies by @Dominastorm in #629
• improved tutorial on rca by @shrjain1312 in #628
• Remove old docs pages and fix broken links by @Dominastorm in #630
• Rearrange and update integrations by @Dominastorm in #634
• Added Promptfoo by @shrjain1312 in #636
• Improve README and update RCA tutorial by @shrjain1312 in #637
• Update README.md by @Dominastorm in #638
• Re-order Key Features in README by @Dominastorm in #639
• Promptfoo Integration Updates by @shrjain1312 in #640
• Update quickstart.mdx by @msalhab96 in #642
• Frontend changes mar by @sanchitadev in #643
• Improve llm output parsing and factual accuracy prompts by @Dominastorm in #645
• v0.6.8 by @Dominastorm in #646

New Contributors

• @msalhab96 made their first contribution in #642

Full Changelog: v0.6.7.post1...v0.6.8

v0.6.7.post1

What's Changed

• Added a cookbook on rag using mistral by @shrjain1312 in #596
• updated docs for rca by @shrjain1312 in #598
• Compare Claude-3 vs. GPT-4 by @Dominastorm in #590
• Update CONTRIBUTING.md by @Dominastorm in #606
• Update pyproject.toml by @Dominastorm in #609
• Langfuse integration by @ashish-1600 in #588
• Fix Code Hallucination and Response Matching by @Dominastorm in #613
• Experiment tutorial improvements + Response matching (include context) by @shrjain1312 in #610
• Pydantic Fix: Change deprecated function by @Dominastorm in #614
• update pyproject.toml by @ashish-1600 in #616
• Experiments: Handling duplicates in data by @shrjain1312 in #617
• promptfoo integration by @shrjain1312 in #587
• Readme fixes by @shrjain1312 in #593
• Remove v0 by @Dominastorm in #612
• Clean docs by @Dominastorm in #611
• Delete .github/workflows/deploy-api-docs.yml by @Dominastorm in #619

Full Changelog: v0.6.6.post3...v0.6.7.post1

v0.6.6.post3

What's Changed

• Docs: improve langfuse introduction by @clemra in #595
• Disable Next.js telemetry in compose by default by @TensorTemplar in #597
• Fix fsspec import error by @Dominastorm in #603

New Contributors

• @clemra made their first contribution in #595
• @TensorTemplar made their first contribution in #597

Full Changelog: v0.6.6.post2...v0.6.6.post3

v0.6.6.post2

What's Changed

• Fix pydantic issues by @Dominastorm in #591
• Update UpTrain version by @Dominastorm in #592
• Add type annotation to Table Operator by @Dominastorm in #594

Full Changelog: v0.6.6.post1...v0.6.6.post2