Skip to content

azure-ai-evaluation_1.0.0b4

Pre-release
Pre-release
Compare
Choose a tag to compare
@azure-sdk azure-sdk released this 16 Oct 20:55
azure-ai-evaluation_1.0.0b4
00b616e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

1.0.0b4 (2024-10-16)

Breaking Changes

  • Removed numpy dependency. All NaN values returned by the SDK have been changed to from numpy.nan to math.nan.
  • credential is now required to be passed in for all content safety evaluators and ProtectedMaterialsEvaluator. DefaultAzureCredential will no longer be chosen if a credential is not passed.
  • Changed package extra name from "pf-azure" to "remote".

Bugs Fixed

  • Adversarial Conversation simulations would fail with Forbidden. Added logic to re-fetch token in the exponential retry logic to retrive RAI Service response.

Other Changes

  • Enhance the error message to provide clearer instruction when required packages for the remote tracking feature are missing.
Assets 2
Loading