v0.3.3rc1

What's Changed

• feat: refactor Ragas embeddings to maintain backward compatibility by @NirantK in #2184
• feat: move tracing from experimental to ragas/integrations by @NirantK in #2188
• feat: Refactor LLM structure and add InstructorLLM by @NirantK in #2191
• fix: setup and local ci by @anistark in #2199
• docs: correct small typos in Testset Generation page and related md components by @deibid in #2123
• Docs/how-to-benchmark-new-llm-guide by @sanjeed5 in #2158
• fix: access model fields via class by @emmanuel-ferdman in #2146
• add: PR template for better review and overview of changes by @anistark in #2202
• Move prompts to ragas by @NirantK in #2197
• Fix: make the answer be the same as the split sentences by @wlbksy in #2128
• Merge workspace.toml into pyproject.toml by @NirantK in #2189
• Cleanup/move-benchmark-llm-to-examples by @sanjeed5 in #2203
• fix: shields badge for downloads replace with pepy. by @anistark in #2204
• refactor: removing some section to streamline pr template by @anistark in #2206
• Move dataset module to main package and update imports by @NirantK in #2205
• fix: type check for pyright by @anistark in #2211
• refactor: move ragas out to project root. by @anistark in #2209
• chore: fix the OIDC error in claude code by @jjmachan in #2212
• fix: _version.py is to be ignored in git by @anistark in #2213
• chore: only review for /claude-review command by @jjmachan in #2214
• Fix a couple of typos in docs/getstarted/evals.md by @sadra-barikbin in #2081
• Fix repeating template bug in _nv_metrics.py by @dev-nid in #2216
• fix: ragas dir structure path fixes by @anistark in #2215
• fix: minor typo in context_precision.md by @AbhishekRP2002 in #2050
• fix: update docstrings for single-hop use case by @terry07 in #1947
• Fix issue with cache hits by @Nicba1010 in #1977
• Use generate_multiple instead of generate in a loop in ResponseRelevancy by @aabanic in #1978
• fix: update required columns in RefusalRate (docs) by @DmitrySirakov in #2008
• Add support for make install-minimal to speed up CI + dev by @rhlbhatnagar in #2218
• Move experimental metrics to main package by @NirantK in #2220
• Fix e2e test failures with datasets>=4.0.0 and missing dependencies by @anistark in #2222
• Move Utils / Exceptions module to main package and update imports by @rhlbhatnagar in #2219
• update compare_embeddings doc links by @resitaydin in #2037
• chore: add py.typed marker file to support type checking by @sisp in #2029
• Retire ragas.experimental namespace by @NirantK in #2223
• chore: cleanup docs for ragas directory by @anistark in #2224
• fix: update make commands to use uv for docs by @anistark in #2217
• Remove experimental folder by @NirantK in #2225
• Docs/how-to-iterate-prompt by @sanjeed5 in #2226
• security: stop supporting v0.2 security releases by @anistark in #2230
• Optimize factual correctness metric runtime by 50% by @vignesh14052002 in #2153
• Fixed the mermaid which was breaking on navigation by @ganeshrvel in #2121
• Fix typos and clean style by @kwinkunks in #2042
• Feature/examples-as-installable-package by @sanjeed5 in #2210
• chore: added reo.js analytics by @jjmachan in #2232
• Move tutorials by @rhlbhatnagar in #2235
• Move howtos by @rhlbhatnagar in #2236
• Move references to docs/ by @rhlbhatnagar in #2234
• Fix BadRequestError while using OpenAI O1 series models | Add option to bypass temperature by @vignesh14052002 in #2151
• feature!: knowledge graph flexibility by @ahgraber in #2030
• return False when pred_sequence length and ref_requence length is dif… by @licux in #1894
• Feature: improve relationship builders for better async and reduced memory utilization by @ahgraber in #2077
• Mirgate all leftover docks from experimental by @rhlbhatnagar in #2243
• Add deprecation warnings for embeddings by @rhlbhatnagar in #2244
• set temperature to 0.01 for better llm compatibility by @0Falli0 in #939
• docs: fix broken link in FAQ (metrics tracing) by @Rahul2512Chauhan in #2238
• fix: temperature change to 0.01 bugs by @anistark in #2247
• Scrubbed the references to app.ragas.io by @ganeshrvel in #2207
• feat: cancellable task by @anistark in #2242
• update: add og images and metadata to docs by @anistark in #2248
• fix: add support for both langchain llm and ragas llm by @anistark in #2229
• chore: analytics support for commonroom and scarf by @jjmachan in #2250

New Contributors

• @deibid made their first contribution in #2123
• @wlbksy made their first contribution in #2128
• @sadra-barikbin made their first contribution in #2081
• @dev-nid made their first contribution in #2216
• @AbhishekRP2002 made their first contribution in #2050
• @terry07 made their first contribution in #1947
• @Nicba1010 made their first contribution in #1977
• @aabanic made their first contribution in #1978
• @rhlbhatnagar made their first contribution in #2218
• @resitaydin made their first contribution in #2037
• @sisp made their first contribution in #2029
• @vignesh14052002 made their first contribution in #2153
• @kwinkunks made their first contribution in #2042
• @0Falli0 made their first contribution in #939
• @Rahul2512Chauhan made their first contribution in #2238

Full Changelog: v0.3.2...v0.3.3rc1