Skip to content

Commit b05ebac

Browse files
Merge pull request #4706 from lgayhardt/patch-46
Update azure-openai-graders.md
2 parents 300e328 + 58f78cc commit b05ebac

File tree

1 file changed

+7
-5
lines changed

1 file changed

+7
-5
lines changed

articles/ai-foundry/concepts/evaluation-evaluators/azure-openai-graders.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,9 @@ ms.author: lagayhar
1111
author: lgayhardt
1212
---
1313

14-
# Azure OpenAI Graders
14+
# Azure OpenAI Graders (preview)
15+
16+
[!INCLUDE [feature-preview](../../includes/feature-preview.md)]
1517

1618
The Azure OpenAI Graders are a new set of evaluation graders available in the Azure AI Foundry SDK, aimed at evaluating the performance of AI models and their outputs. These graders including [Label grader](#label-grader), [String checker](#string-checker), [Text similarity](#text-similarity), and [General grader](#general-grader) can be run locally or remotely. Each grader serves a specific purpose in assessing different aspects of AI model/model outputs.
1719

@@ -209,17 +211,17 @@ The grader also returns a metric indicating the overall dataset pass rate.
209211

210212
## General grader
211213

212-
Advanced users have the capability to import or define a custom grader and integrate it into the Azure OpenAI general grader. This allows for evaluations to be performed based on specific areas of interest aside from the existing Azure OpenAI graders. Following is an example to import the OpenAI `EvalStringCheckGrader` and construct it to be ran as an Azure OpenAI general grader on Foundry SDK.
214+
Advanced users have the capability to import or define a custom grader and integrate it into the AOAI general grader. This allows for evaluations to be performed based on specific areas of interest aside from the existing AOAI graders. Following is an example to import the OpenAI `StringCheckGrader` and construct it to be ran as a AOAI general grader on Foundry SDK.
213215

214216
### Example
215217

216218
```python
217-
from openai.types.eval_string_check_grader import EvalStringCheckGrader
219+
from openai.types.graders import StringCheckGrader
218220
from azure.ai.evaluation import AzureOpenAIGrader
219-
221+
220222
# Define an string check grader config directly using the OAI SDK
221223
# Evaluation criteria: Pass if query column contains "Northwind"
222-
oai_string_check_grader = EvalStringCheckGrader(
224+
oai_string_check_grader = StringCheckGrader(
223225
input="{{item.query}}",
224226
name="contains hello",
225227
operation="like",

0 commit comments

Comments
 (0)