v0.3.2rc3

chore: fix release script (#2198)

v0.3.2-rc2

What's Changed

• fix: pypi requirements and image absolute path by @anistark in #2196

Full Changelog: v0.3.2-rc1...v0.3.2-rc2

v0.3.2-rc1

What's Changed

• feat: save and load prompt object by @jjmachan in #2152
• refactor: use basemetric as base for metric by @anistark in #2163
• add: pre-commit hook to run ci on every commit by @anistark in #2164
• Make AnswerSimilarity a dataclass by @hutec in #2159
• docs: Add discord link to Community page in docs by @sanjeed5 in #2157
• Fixed a small typo in context_precision.md by @ImadSaddik in #2166
• Move Experimental to inside Ragas by @NirantK in #2167
• refactor: experiment function to use model as additional optional arg by @anistark in #2165
• Add python 3.13 target, refactor on pre-commit and benchmarking tests by @anistark in #2169
• fix: enum values instead of names in testset synthesizers by @lovets18 in #2137
• Cleaner, simpler pyproject.toml by @NirantK in #2173
• Move Examples to root by @NirantK in #2176
• Add backend to ragas main by @NirantK in #2174
• Remove txt requirements by @NirantK in #2180
• Remove black by @NirantK in #2178
• feat: move experiment from experimental to ragas main by @NirantK in #2175
• feat: migrate CLI from experimental to main package by @NirantK in #2183
• Reformat examples by @NirantK in #2186
• Remove simulation by @NirantK in #2187
• refactor: avoid notebook in test. run all in test-all by @anistark in #2171
• Add Claude Code GitHub Workflow by @jjmachan in #2192
• hotfix: Include LICENSE and README.md in PyPI package by @NirantK in #2195

New Contributors

• @anistark made their first contribution in #2163
• @hutec made their first contribution in #2159
• @ImadSaddik made their first contribution in #2166
• @lovets18 made their first contribution in #2137

Full Changelog: v0.3.1...v0.3.2-rc1

v0.3.1

What's Changed

• docs: improve hello world by @shahules786 in #2127
• examples: fix api changes by @shahules786 in #2129
• docs: add explanation by @shahules786 in #2139
• adds Google Drive backend for storing datasets as sheets by @dmikey in #2138
• Fix experimental docs navigation, fix broken tutorials, improve examples for better user understanding by @sanjeed5 in #2156
• fix: correct mkdocstrings path configuration for local development by @sanjeed5 in #2155

New Contributors

• @dmikey made their first contribution in #2138
• @sanjeed5 made their first contribution in #2156

Full Changelog: v0.3.0...v0.3.1

v0.3.0

What's Changed

• llamaindex agentic integration by @sahusiddharth in #2026
• CVE-2025-45691 Fix: Arbitrary File Read Vulnerability + Feat: Security settings by @adithyan-ak in #1991
• feat: add devin's deepwiki by @jjmachan in #2039
• feat: added ragas_experimental back into main by @jjmachan in #2031
• fix: dataset slicing by @shahules786 in #2057
• feat: user simulator by @shahules786 in #2062
• chore: make CI pass by @jjmachan in #2063
• Update analytics source by @emmanuel-ferdman in #2059
• fix: update embedding extraction to use appropriate async method by @ahgraber in #2068
• feat: check embedding shapes in CosineSimilarityBuilders by @ahgraber in #2069
• feat: llm as prompt as optional by @shahules786 in #2084
• chore: added claude code workflow by @jjmachan in #2089
• chore: refactor the experimental code off nbdev by @jjmachan in #2087
• feat: align and validate alignment rate by @shahules786 in #2094
• Fix/docs upgrade shade 2 by @ganeshrvel in #2097
• feat: ragas evals CLI by @shahules786 in #2086
• docs: hello world for ragas experimental by @shahules786 in #2100
• feat: refactored out Project by @jjmachan in #2106
• Updated the header color and moved away from yellow shade to more dar… by @ganeshrvel in #2104
• examples : example evals by @shahules786 in #2109
• Fix/theme black primary color by @ganeshrvel in #2113
• fix: cleaned up some metrics by @jjmachan in #2111
• feat: add llm_factory and embedding_factory by @jjmachan in #2112
• chore: release scripts and cleanup for monorepo by @jjmachan in #2117
• fix: release script by @jjmachan in #2118
• docs: hello world & explanation by @shahules786 in #2114
• chore: added ragas.experimental and cleaned dependencies by @jjmachan in #2119
• fix: metric alignment with inmemory backend by @jjmachan in #2116
• docs: added structure to sidebar by @jjmachan in #2120

New Contributors

• @emmanuel-ferdman made their first contribution in #2059

Full Changelog: v0.2.15...v0.3.0

v0.3.0-rc2

fix: release script (#2118)

v0.3.0-rc1

chore: release scripts and cleanup for monorepo (#2117)

v0.2.15

What's Changed

• md of vertexai notebooks by @sahusiddharth in #1957
• Single-hop query testset generation tutorial by @sahusiddharth in #1959
• AWS Bedrock Integration by @sahusiddharth in #1974
• Benchmarking Tutorial by @sahusiddharth in #1984
• Create SECURITY.md by @adithyan-ak in #1987
• Evaluation function documentation improvements by @gbrlbd in #1965
• directory name change in docs by @sahusiddharth in #1966
• Detailed error message for noise sensitivity metric by @KalyanKS-NLP in #1986
• Docs: Fixed broken links in nav bar for NVIDIA metrics by @sahusiddharth in #1971
• Refactor: Update AWS Bedrock Naming to Amazon Bedrock Across Docs & Repo Structure by @sahusiddharth in #1982
• LlamaStack integration by @sahusiddharth in #2011
• Adding the link to download the utils and minor changes by @sahusiddharth in #2003
• Enhance MultiTurnSample Validator to Support Multiple Tool Calls by @sahusiddharth in #2017
• Griptape integration by @sahusiddharth in #2021
• Fix shared examples bug in FactualCorrectness metric by @sahusiddharth in #2016
• docs: removed SUPPORTED_LANGUAGE by @DmitrySirakov in #2020
• docs: add CTA for Ragas app by @shahules786 in #2023

New Contributors

• @adithyan-ak made their first contribution in #1987
• @gbrlbd made their first contribution in #1965
• @KalyanKS-NLP made their first contribution in #1986
• @DmitrySirakov made their first contribution in #2020

Full Changelog: v0.2.14...v0.2.15

v0.2.14

What's Changed

• feat: add http request-response logging with env flag control by @ganeshrvel in #1903
• Metric with different parameter gives different score by @sahusiddharth in #1908
• Updated the instruction of StatementGeneratorPrompt in faithfulness by @sahusiddharth in #1906
• Fixed simple criteria metric by @sahusiddharth in #1909
• Evaluating Multi-Turn Conversations by @sahusiddharth in #1919
• fix SingleHopQuerySynthesizer::prepare_combinations() by @lryan599 in #1921
• docs: fix semantic similarity description (cross-encoder -> bi-encoder) by @Ayaka-mogumogu in #1910
• docs: list googles model provider by @jjmachan in #1920
• nvidia end-2-end accuracy, relevance and groundedness metrics by @titericz in #1913
• Enable Runtime Checks for ModeMetric Protocol by @sahusiddharth in #1929
• r2r integration by @sahusiddharth in #1918
• Haystack llm and embedding wrapper by @sahusiddharth in #1901
• Easy fix, Groundedness metric, 5 retries early break. by @titericz in #1935
• nvidia docs by @sahusiddharth in #1940
• unnecessary Noise Sensitivity name update by @sahusiddharth in #1943
• When saving kg only save the node id in the relationships by @lryan599 in #1926
• fix: return valid JSON output schema by @alasdairsmith in #1933
• Update default.py - Missing cosine_similarity transform for docs with Token Count 101–500 by @rgrizzo-linksmt in #1934
• Ndarray dtype fix, improve error wording by @zybinmikhail in #1924

New Contributors

• @lryan599 made their first contribution in #1921
• @Ayaka-mogumogu made their first contribution in #1910
• @titericz made their first contribution in #1913
• @alasdairsmith made their first contribution in #1933
• @rgrizzo-linksmt made their first contribution in #1934
• @zybinmikhail made their first contribution in #1924

Full Changelog: v0.2.13...v0.2.14

v0.2.13

What's Changed

• Improved the documentation in the migration docs by @sahusiddharth in #1873
• docs: match default timeout in RunConfig by @neo in #1872
• fix(prompt/mixin): Add name property and add it to saving/loading path. by @tim-hilde in #1853
• Adding missing evaluate import to evals guide by @carlosgsouza in #1876
• Improve error message for missing embeddings in Answer Relevancy Metric by @sahusiddharth in #1877
• Change the validate_samples functionality by @Vidit-Ostwal in #1879
• chore: added openhands for solving some github issues by @jjmachan in #1884
• Fix Broken Test Case Due to Changed Error Message by @sahusiddharth in #1881
• Faithfulness prompt update to avoid having single quotes in response by @michaelromagne in #1874
• Internal logging and tracing improvements. by @ganeshrvel in #1886
• docs: added office hour links by @jjmachan in #1888
• added the end of sequence token for the WatsonX family of models by @malikaltakrori in #1883
• Enhance langgraph integration to preserve metadata by @i-w-a in #1878
• Adding tutorial for Haystack Integration by @sahusiddharth in #1887
• Remove llm argument from ToolCallAccuracy initialization by @sahusiddharth in #1891
• Updated Application Page by @sahusiddharth in #1899
• fix: UnicodeEncode error when save/load knowledge graph by @jjmachan in #1900

New Contributors

• @tim-hilde made their first contribution in #1853
• @carlosgsouza made their first contribution in #1876
• @Vidit-Ostwal made their first contribution in #1879
• @malikaltakrori made their first contribution in #1883

Full Changelog: v0.2.12...v0.2.13