Releases: evidentlyai/evidently
Releases · evidentlyai/evidently
v0.7.20
What's Changed
- fix docker build by @DimaAmega in #1790
- Example of openinference instrumentations for traces. by @Liraim in #1786
- Lock version of pathspec to <1 for dvc. by @Liraim in #1791
Full Changelog: v0.7.19...v0.7.20
v0.7.19
What's Changed
- CI: fix API reference generation by @DimaAmega in #1778
- Fix: protect write API routers with guard for
artifactandpromptroutes by @DimaAmega in #1779 - move to UV by @mike0sv in #1759
- Feature/more api ref by @mike0sv in #1780
- feat:
fetch-depth: 0for checking outgh-pagesby @DimaAmega in #1782 - UI: (EvidentlyUIRunner) add
Go to pagelink inshow_serviceby @DimaAmega in #1787 - Fix: protect tracing api with guard by @DimaAmega in #1788
- all other docstrings by @mike0sv in #1783
- API for human feedback in tracing by @Liraim in #1784
- feat: api-reference works for forks by @DimaAmega in #1789
Full Changelog: v0.7.18...v0.7.19
v0.7.18
What's Changed
- Versioned artefacts (unified prompts and configs) by @mike0sv in #1750
- Update litestar dependency to version 2.18.0 and add sniffio for now by @DimaAmega in #1753
- Support reload snapshot points for dashboards in local version. by @Liraim in #1752
- UI: loading state in create new prompt form by @DimaAmega in #1754
- fix none labels for points by @mike0sv in #1755
- Add sklearn datasets cache for min tests. by @Liraim in #1757
- Fix download lfw dataset for tests by @Liraim in #1758
- Feature: run
evidently uiin background viaEvidentlyUIRunnerinterface by @DimaAmega in #1756 - UI: add
evidently-ai-logo.pngby @DimaAmega in #1761 - Feature:
api-referencegeneration by @DimaAmega in #1760 - Feature: Add local development script for API reference documentation by @DimaAmega in #1762
- bump litestar to
2.19.0by @DimaAmega in #1770 - Database Authentication Failures Due to Password Masking in Migration by @jasperbruin in #1767
- Support for openinference data in traces. by @Liraim in #1768
- Update API Reference by @mike0sv in #1769
- refactor around
api-referenceby @DimaAmega in #1774 - Fix datasets download for tests by @Liraim in #1772
- Fix reload_projects test for Application. by @Liraim in #1775
- fix: correct typos and improve readability in README by @Pro-phet123 in #1735
- New notebook
tracing_with_service.ipynbby @DimaAmega in #1763 - CI: fix release build step by @DimaAmega in #1777
- CI: api reference for release by @DimaAmega in #1776
New Contributors
- @jasperbruin made their first contribution in #1767
- @Pro-phet123 made their first contribution in #1735
Full Changelog: v0.7.17...v0.7.18
v0.7.17
What's Changed
- reviews demo by @mike0sv in #1741
- Datasets: post release by @DimaAmega in #1740
- Support Cloud API keys in OSS SDK by @Liraim in #1742
- Tracing support by @mike0sv in #1743
- Support list_datasets and load_dataset for local Workspace by @mike0sv in #1746
- UI: fix
DatasetViewerslots prop by @DimaAmega in #1749 - fix loading local tracing datasets by @mike0sv in #1748
Full Changelog: v0.7.16...v0.7.17
v0.7.16
What's Changed
- Support column types in GenericLLMDescriptor. by @Liraim in #1725
- UI: refactor panels data fetch by @DimaAmega in #1727
- Resolved params by @mike0sv in #1726
- Add
HumanFeedbacktoServiceColumnsby @DimaAmega in #1728 - DataFrame tests by @mike0sv in #1729
- Feature/sql service by @mike0sv in #1734
- Convert type for numerical descriptor fields. by @Liraim in #1737
- Dataset support by @mike0sv in #1736
- fix windows tests by @mike0sv in #1738
- UI: fix datasets by @DimaAmega in #1739
Full Changelog: v0.7.15...v0.7.16
v0.7.15
What's Changed
- Fix for parsing error in DataDefinition. by @Liraim in #1709
- add config kwargs by @mike0sv in #1707
- Feature/llm eval v2 by @mike0sv in #1710
- Tracing support for guardrails. by @Liraim in #1708
- Add column correlations metric by @mike0sv in #1711
- Add llm template registry example by @mike0sv in #1713
- Guards tracing attributes and error messages fixes. by @Liraim in #1716
- Separate correlations into metric + preset by @mike0sv in #1715
- New guards: Toxicity and Negativity. by @Liraim in #1717
- Preinstall torch cpu for linux builds. by @Liraim in #1719
- Text Matches by @mike0sv in #1718
- Feature/new recsys by @mike0sv in #1720
- Add tab and dashboard info to panel renders. by @Liraim in #1722
- update descriptors notebook by @mike0sv in #1723
- Additional data and other recsys metrics by @mike0sv in #1721
Full Changelog: v0.7.14...v0.7.15
v0.7.14
Full Changelog: v0.7.13...v0.7.14
v0.7.13
What's Changed
- UI: use vite v6 by @DimaAmega in #1694
- Refactor
setup.py: remove unused by @DimaAmega in #1687 - UI: Update
AlertThemedcomponent by @DimaAmega in #1696 - UI: remove v1 stuff by @DimaAmega in #1697
- Better CI: merge
ui.ymlintomain.ymlby @DimaAmega in #1698 - datagen providers tutorial update by @mike0sv in #1703
- better readability in llm judges by @DimaAmega in #1702
- Feature: Guardrails. by @Liraim in #1701
- Feature/better optimizer by @mike0sv in #1704
- Add descriptive error messages for missing classification metrics by @PS5138 in #1705
- Support for multiple classifications and regressions. by @Liraim in #1682
- Update Contributing.md Documentation for Extras Installation by @pagrim in #1674
- Render row tests by @mike0sv in #1695
New Contributors
Full Changelog: v0.7.12...v0.7.13
v0.7.12
What's Changed
- Improve Regression presets tests configuration. by @Liraim in #1664
- Changed Vite dependency from version 5.2.12 to rolldown-vite@7.0.8 by @DimaAmega in #1658
- Minor improvement for metric tests by @Liraim in #1668
- Update Python base image to
3.11-slim-bookwormin Dockerfiles by @DimaAmega in #1669 - Feature/column tests widgets by @mike0sv in #1666
- Raising Exception for Missing
mean_testsorstd_testsin MAE Metric by @bharath03-a in #1661 - regression presets with tests by @emeli-dral in #1671
- Update README.md by @DimaAmega in #1617
- tutorial on data drift grafana dashboard by @emeli-dral in #1672
- fix fewshot serialization by @mike0sv in #1675
- tutorial on grafana dashboard for llm by @emeli-dral in #1677
- Fix NotImplementedError when using tests with Generators by @Liraim in #1678
- New metric: SumValue. by @Liraim in #1676
- Fix IncludesWords / ExcludesWords serialization error. by @Liraim in #1680
- fix delete snapshot by @mike0sv in #1679
- fix observer failing on incomplete snapshots by @mike0sv in #1681
- chore(metrics): remove redundant "columns" text in error messages and clean up string formatting by @mircohoehne in #1683
- feat(docker): Allow installing optional extras in service image in order to support S3 and GCS usage by @israolive in #1684
- feat(ui): add script to replace Playwright screenshots based on test results by @DimaAmega in #1688
- Fix creating eq / not_eq tests with string expected value. by @Liraim in #1686
- Better prompt optimizer api + no scorer/executor by @mike0sv in #1689
- Fix unique_value_count display names for missing labels. by @Liraim in #1690
- RowTests for TextEvals by @mike0sv in #1691
- Fix RowTestSummary tests. by @Liraim in #1692
New Contributors
- @bharath03-a made their first contribution in #1661
- @mircohoehne made their first contribution in #1683
- @israolive made their first contribution in #1684
Full Changelog: v0.7.11...v0.7.12
v0.7.11
What's Changed
- Feature/new datagen by @mike0sv in #1653
- UI: use theme color for project ID text by @DimaAmega in #1655
- UI: create
projectscrumb by @DimaAmega in #1656 - UI: commit UI assets by @DimaAmega in #1657
- update litellm providers by @mike0sv in #1662
- fix custom providers by @mike0sv in #1663
- New datagen by @mike0sv in #1654
- fix llm message validation by @mike0sv in #1665
Full Changelog: v0.7.10...v0.7.11