Skip to content

Commit 7a9f7cc

Browse files
Copilotslister1001
andcommitted
Remove backward compatibility for _evaluate_query parameter and update changelog
Co-authored-by: slister1001 <[email protected]>
1 parent 0470066 commit 7a9f7cc

File tree

2 files changed

+2
-21
lines changed

2 files changed

+2
-21
lines changed

sdk/evaluation/azure-ai-evaluation/CHANGELOG.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,8 @@
22

33
## 1.10.0 (Unreleased)
44

5-
### Breaking Changes
6-
- Added `_evaluate_query` parameter to `RaiServiceEvaluatorBase` class with a default value of `False`. This parameter controls whether queries are included in evaluation data when evaluating query-response pairs. Previously, queries were always included in evaluations. Existing code that relies on queries being evaluated will need to explicitly set `_evaluate_query=True` to maintain the previous behavior.
7-
85
### Features Added
9-
- Refactored `_evaluate_query` parameter from private to public API using kwargs pattern across all RAI service evaluators. The parameter now follows standard kwargs conventions instead of being an explicit parameter. The old `_evaluate_query` parameter is still supported but deprecated with a warning. Users should pass `evaluate_query` as a keyword argument instead of using the private `_evaluate_query` parameter.
6+
- Added `evaluate_query` parameter to all RAI service evaluators that can be passed as a keyword argument. This parameter controls whether queries are included in evaluation data when evaluating query-response pairs. When set to `True`, both query and response will be evaluated; when set to `False` (default), only the response will be evaluated. This parameter is available across all RAI service evaluators including `ContentSafetyEvaluator`, `ViolenceEvaluator`, `SexualEvaluator`, `SelfHarmEvaluator`, `HateUnfairnessEvaluator`, `ProtectedMaterialEvaluator`, `IndirectAttackEvaluator`, `CodeVulnerabilityEvaluator`, `UngroundedAttributesEvaluator`, `GroundednessProEvaluator`, and `EciEvaluator`.
107

118
### Bugs Fixed
129

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_common/_base_rai_svc_eval.py

Lines changed: 1 addition & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -73,23 +73,7 @@ def __init__(
7373
self._threshold = threshold
7474

7575
# Handle evaluate_query parameter from kwargs
76-
evaluate_query = kwargs.get('evaluate_query', False)
77-
_evaluate_query = kwargs.get('_evaluate_query', None)
78-
79-
# Handle backward compatibility with _evaluate_query parameter
80-
if _evaluate_query is not None:
81-
import warnings
82-
warnings.warn(
83-
"The '_evaluate_query' parameter is deprecated. Use 'evaluate_query' instead.",
84-
DeprecationWarning,
85-
stacklevel=2
86-
)
87-
# If both are provided, that's an error
88-
if 'evaluate_query' in kwargs: # evaluate_query was explicitly passed
89-
raise ValueError("Cannot specify both 'evaluate_query' and '_evaluate_query'. Use 'evaluate_query'.")
90-
evaluate_query = _evaluate_query
91-
92-
self._evaluate_query = evaluate_query
76+
self._evaluate_query = kwargs.get('evaluate_query', False)
9377
self._higher_is_better = _higher_is_better
9478

9579
@override

0 commit comments

Comments
 (0)