Releases: explodinggradients/ragas
Releases · explodinggradients/ragas
v0.3.2rc3
v0.3.2-rc2
What's Changed
Full Changelog: v0.3.2-rc1...v0.3.2-rc2
v0.3.2-rc1
What's Changed
- feat: save and load prompt object by @jjmachan in #2152
- refactor: use basemetric as base for metric by @anistark in #2163
- add: pre-commit hook to run ci on every commit by @anistark in #2164
- Make
AnswerSimilaritya dataclass by @hutec in #2159 - docs: Add discord link to Community page in docs by @sanjeed5 in #2157
- Fixed a small typo in context_precision.md by @ImadSaddik in #2166
- Move Experimental to inside Ragas by @NirantK in #2167
- refactor: experiment function to use model as additional optional arg by @anistark in #2165
- Add python 3.13 target, refactor on pre-commit and benchmarking tests by @anistark in #2169
- fix: enum values instead of names in testset synthesizers by @lovets18 in #2137
- Cleaner, simpler pyproject.toml by @NirantK in #2173
- Move Examples to root by @NirantK in #2176
- Add
backendto ragas main by @NirantK in #2174 - Remove txt requirements by @NirantK in #2180
- Remove black by @NirantK in #2178
- feat: move
experimentfrom experimental to ragas main by @NirantK in #2175 - feat: migrate CLI from experimental to main package by @NirantK in #2183
- Reformat examples by @NirantK in #2186
- Remove simulation by @NirantK in #2187
- refactor: avoid notebook in test. run all in test-all by @anistark in #2171
- Add Claude Code GitHub Workflow by @jjmachan in #2192
- hotfix: Include LICENSE and README.md in PyPI package by @NirantK in #2195
New Contributors
- @anistark made their first contribution in #2163
- @hutec made their first contribution in #2159
- @ImadSaddik made their first contribution in #2166
- @lovets18 made their first contribution in #2137
Full Changelog: v0.3.1...v0.3.2-rc1
v0.3.1
What's Changed
- docs: improve hello world by @shahules786 in #2127
- examples: fix api changes by @shahules786 in #2129
- docs: add explanation by @shahules786 in #2139
- adds Google Drive backend for storing datasets as sheets by @dmikey in #2138
- Fix experimental docs navigation, fix broken tutorials, improve examples for better user understanding by @sanjeed5 in #2156
- fix: correct mkdocstrings path configuration for local development by @sanjeed5 in #2155
New Contributors
Full Changelog: v0.3.0...v0.3.1
v0.3.0
What's Changed
- llamaindex agentic integration by @sahusiddharth in #2026
- CVE-2025-45691 Fix: Arbitrary File Read Vulnerability + Feat: Security settings by @adithyan-ak in #1991
- feat: add devin's deepwiki by @jjmachan in #2039
- feat: added
ragas_experimentalback into main by @jjmachan in #2031 - fix: dataset slicing by @shahules786 in #2057
- feat: user simulator by @shahules786 in #2062
- chore: make CI pass by @jjmachan in #2063
- Update analytics source by @emmanuel-ferdman in #2059
- fix: update embedding extraction to use appropriate async method by @ahgraber in #2068
- feat: check embedding shapes in CosineSimilarityBuilders by @ahgraber in #2069
- feat: llm as prompt as optional by @shahules786 in #2084
- chore: added claude code workflow by @jjmachan in #2089
- chore: refactor the experimental code off nbdev by @jjmachan in #2087
- feat: align and validate alignment rate by @shahules786 in #2094
- Fix/docs upgrade shade 2 by @ganeshrvel in #2097
- feat: ragas evals CLI by @shahules786 in #2086
- docs: hello world for ragas experimental by @shahules786 in #2100
- feat: refactored out
Projectby @jjmachan in #2106 - Updated the header color and moved away from yellow shade to more dar… by @ganeshrvel in #2104
- examples : example evals by @shahules786 in #2109
- Fix/theme black primary color by @ganeshrvel in #2113
- fix: cleaned up some metrics by @jjmachan in #2111
- feat: add
llm_factoryandembedding_factoryby @jjmachan in #2112 - chore: release scripts and cleanup for monorepo by @jjmachan in #2117
- fix: release script by @jjmachan in #2118
- docs: hello world & explanation by @shahules786 in #2114
- chore: added
ragas.experimentaland cleaned dependencies by @jjmachan in #2119 - fix: metric alignment with
inmemorybackend by @jjmachan in #2116 - docs: added structure to sidebar by @jjmachan in #2120
New Contributors
- @emmanuel-ferdman made their first contribution in #2059
Full Changelog: v0.2.15...v0.3.0
v0.3.0-rc2
fix: release script (#2118)
v0.3.0-rc1
chore: release scripts and cleanup for monorepo (#2117)
v0.2.15
What's Changed
- md of vertexai notebooks by @sahusiddharth in #1957
- Single-hop query testset generation tutorial by @sahusiddharth in #1959
- AWS Bedrock Integration by @sahusiddharth in #1974
- Benchmarking Tutorial by @sahusiddharth in #1984
- Create SECURITY.md by @adithyan-ak in #1987
- Evaluation function documentation improvements by @gbrlbd in #1965
- directory name change in docs by @sahusiddharth in #1966
- Detailed error message for noise sensitivity metric by @KalyanKS-NLP in #1986
- Docs: Fixed broken links in nav bar for NVIDIA metrics by @sahusiddharth in #1971
- Refactor: Update AWS Bedrock Naming to Amazon Bedrock Across Docs & Repo Structure by @sahusiddharth in #1982
- LlamaStack integration by @sahusiddharth in #2011
- Adding the link to download the utils and minor changes by @sahusiddharth in #2003
- Enhance MultiTurnSample Validator to Support Multiple Tool Calls by @sahusiddharth in #2017
- Griptape integration by @sahusiddharth in #2021
- Fix shared examples bug in FactualCorrectness metric by @sahusiddharth in #2016
- docs: removed SUPPORTED_LANGUAGE by @DmitrySirakov in #2020
- docs: add CTA for Ragas app by @shahules786 in #2023
New Contributors
- @adithyan-ak made their first contribution in #1987
- @gbrlbd made their first contribution in #1965
- @KalyanKS-NLP made their first contribution in #1986
- @DmitrySirakov made their first contribution in #2020
Full Changelog: v0.2.14...v0.2.15
v0.2.14
What's Changed
- feat: add http request-response logging with env flag control by @ganeshrvel in #1903
- Metric with different parameter gives different score by @sahusiddharth in #1908
- Updated the instruction of
StatementGeneratorPromptin faithfulness by @sahusiddharth in #1906 - Fixed simple criteria metric by @sahusiddharth in #1909
- Evaluating Multi-Turn Conversations by @sahusiddharth in #1919
- fix SingleHopQuerySynthesizer::prepare_combinations() by @lryan599 in #1921
- docs: fix semantic similarity description (cross-encoder -> bi-encoder) by @Ayaka-mogumogu in #1910
- docs: list googles model provider by @jjmachan in #1920
- nvidia end-2-end accuracy, relevance and groundedness metrics by @titericz in #1913
- Enable Runtime Checks for ModeMetric Protocol by @sahusiddharth in #1929
- r2r integration by @sahusiddharth in #1918
- Haystack llm and embedding wrapper by @sahusiddharth in #1901
- Easy fix, Groundedness metric, 5 retries early break. by @titericz in #1935
- nvidia docs by @sahusiddharth in #1940
- unnecessary Noise Sensitivity name update by @sahusiddharth in #1943
- When saving kg only save the node id in the relationships by @lryan599 in #1926
- fix: return valid JSON output schema by @alasdairsmith in #1933
- Update default.py - Missing
cosine_similaritytransform for docs with Token Count 101–500 by @rgrizzo-linksmt in #1934 - Ndarray dtype fix, improve error wording by @zybinmikhail in #1924
New Contributors
- @lryan599 made their first contribution in #1921
- @Ayaka-mogumogu made their first contribution in #1910
- @titericz made their first contribution in #1913
- @alasdairsmith made their first contribution in #1933
- @rgrizzo-linksmt made their first contribution in #1934
- @zybinmikhail made their first contribution in #1924
Full Changelog: v0.2.13...v0.2.14
v0.2.13
What's Changed
- Improved the documentation in the migration docs by @sahusiddharth in #1873
- docs: match default
timeoutinRunConfigby @neo in #1872 - fix(prompt/mixin): Add name property and add it to saving/loading path. by @tim-hilde in #1853
- Adding missing evaluate import to evals guide by @carlosgsouza in #1876
- Improve error message for missing embeddings in Answer Relevancy Metric by @sahusiddharth in #1877
- Change the validate_samples functionality by @Vidit-Ostwal in #1879
- chore: added openhands for solving some github issues by @jjmachan in #1884
- Fix Broken Test Case Due to Changed Error Message by @sahusiddharth in #1881
- Faithfulness prompt update to avoid having single quotes in response by @michaelromagne in #1874
- Internal logging and tracing improvements. by @ganeshrvel in #1886
- docs: added office hour links by @jjmachan in #1888
- added the end of sequence token for the WatsonX family of models by @malikaltakrori in #1883
- Enhance langgraph integration to preserve metadata by @i-w-a in #1878
- Adding tutorial for Haystack Integration by @sahusiddharth in #1887
- Remove llm argument from ToolCallAccuracy initialization by @sahusiddharth in #1891
- Updated Application Page by @sahusiddharth in #1899
- fix: UnicodeEncode error when save/load knowledge graph by @jjmachan in #1900
New Contributors
- @tim-hilde made their first contribution in #1853
- @carlosgsouza made their first contribution in #1876
- @Vidit-Ostwal made their first contribution in #1879
- @malikaltakrori made their first contribution in #1883
Full Changelog: v0.2.12...v0.2.13