Skip to content

Commit a442175

Browse files
committed
articles-about-evaluating-apps-with-Azure-AI-Evaluation-SDK
1 parent 4b1954e commit a442175

File tree

4 files changed

+10
-5
lines changed

4 files changed

+10
-5
lines changed

articles/ai-foundry/how-to/develop/agent-evaluate-sdk.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,18 @@
1+
---
12
title: Agent Evaluation with the Azure AI Evaluation SDK
23
titleSuffix: Azure AI Foundry
34
description: This article provides instructions on how to evaluate an AI agent with the Azure AI Evaluation SDK.
45
Manager: scottpolly
56
ms.service: azure-ai-foundry
6-
ms.custom: build-2025, references_regions
7+
ms.custom:
8+
- build-2025
9+
- references_regions
710
ms.topic: how-to
811
ms.date: 04/04/2025
912
ms.reviewer: changliu2
1013
author:
1114
ms.author: lagayhar
1215
author: lgayhardt
13-
1416
---
1517

1618
# Evaluate your AI agents locally with the Azure AI Evaluation SDK (preview)
@@ -308,7 +310,7 @@ After the URI, you'll be redirected to Foundry to view your evaluation results i
308310

309311
With the Azure AI Evaluation SDK client library, you can seamlessly evaluate your Azure AI agents via our converter support, which enables observability and transparency into agentic workflows.
310312

311-
## Evaluate other agents
313+
## <a name = "evaluating-other-agents"></a> Evaluate other agents
312314

313315
If you're using agents outside of Azure AI Foundry Agent Service, you can still evaluate them by preparing the right data for the evaluators of your choice.
314316

articles/ai-foundry/how-to/develop/cloud-evaluation.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ ms.reviewer: changliu2
1313
ms.author: lagayhar
1414
author: lgayhardt
1515
---
16+
1617
# Run evaluations in the cloud by using the Azure AI Foundry SDK (preview)
1718

1819
[!INCLUDE [feature-preview](../../includes/feature-preview.md)]
@@ -73,7 +74,7 @@ project_client = AIProjectClient(
7374
)
7475
```
7576

76-
## Upload evaluation data
77+
## <a name = "uploading-evaluation-data"></a> Upload evaluation data
7778

7879
```python
7980
# Upload a local JSONL file (skip if you already have a Dataset registered)

articles/ai-foundry/how-to/develop/simulator-interaction-data.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -403,6 +403,8 @@ The `AdversarialSimulator` supports a range of scenarios, hosted in the service,
403403

404404
### Simulate jailbreak attacks
405405

406+
## <a name = "simulating-jailbreak-attacks"></a> Simulate Jailbreak Attacks
407+
406408
Evaluating vulnerability towards the following types of jailbreak attacks is supported:
407409

408410
- **Direct attack jailbreak**: This type of attack, also known as a user prompt injected attack (UPIA), injects prompts in the user role turn of conversations or queries to generative AI applications.

articles/ai-foundry/how-to/evaluate-generative-ai-app.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: Evaluate your generative AI models and applications by using Azure
55
manager: scottpolly
66
ms.service: azure-ai-foundry
77
ms.custom: ignite-2023, references_regions, build-2024, ignite-2024
8-
ms.topic: how-toi-
8+
ms.topic: how-to
99
ms.date: 05/19/2025
1010
ms.reviewer: mithigpe
1111
ms.author: lagayhar

0 commit comments

Comments
 (0)