Skip to content

Commit 65f8820

Browse files
committed
Merge branch 'main' into release-preview-ptu
2 parents 994cb55 + 1414ad4 commit 65f8820

File tree

90 files changed

+789
-696
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

90 files changed

+789
-696
lines changed

articles/ai-foundry/ai-services/content-safety-overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-ai-foundry
77
ms.custom:
88
- ignite-2024
99
ms.topic: overview
10-
ms.date: 05/01/2025
10+
ms.date: 05/31/2025
1111
ms.author: pafarley
1212
author: PatrickFarley
1313
---

articles/ai-foundry/concepts/content-filtering.md

Lines changed: 4 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.custom:
99
- build-2024
1010
- ignite-2024
1111
ms.topic: conceptual
12-
ms.date: 04/29/2025
12+
ms.date: 05/31/2025
1313
ms.reviewer: eur
1414
ms.author: pafarley
1515
author: PatrickFarley
@@ -24,9 +24,9 @@ author: PatrickFarley
2424
2525
## How it works
2626

27-
The content filtering system is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md), and it works by running both the prompt input and completion output through a set of classification models designed to detect and prevent the output of harmful content. Variations in API configurations and application design might affect completions and thus filtering behavior.
27+
The content filtering system is powered by [Azure AI Content Safety](../../ai-services/content-safety/overview.md), and it works by running both the model prompt input and completion output through a set of classification models designed to detect and prevent the output of harmful content. Variations in API configurations and application design might affect completions and thus filtering behavior.
2828

29-
With Azure OpenAI model deployments, you can use the default content filter or create your own content filter (described later on). Models available through **standard deployments** have content filtering enabled by default. To learn more about the default content filter enabled for standard deployments, see [Content safety for Models Sold Directly by Azure ](model-catalog-content-safety.md).
29+
With Azure OpenAI model deployments, you can use the default content filter or create your own content filter (described later). Models available through **standard deployments** have content filtering enabled by default. To learn more about the default content filter enabled for standard deployments, see [Content safety for Models Sold Directly by Azure ](model-catalog-content-safety.md).
3030

3131
## Language support
3232

@@ -73,20 +73,7 @@ You can also enable the following special output filters:
7373

7474
### Configurability (preview)
7575

76-
The default content filtering configuration for the GPT model series is set to filter at the medium severity threshold for all four content harm categories (hate, violence, sexual, and self-harm) and applies to both prompts (text, multi-modal text/image) and completions (text). This means that content that is detected at severity level medium or high is filtered, while content detected at severity level low isn't filtered by the content filters. For DALL-E, the default severity threshold is set to low for both prompts (text) and completions (images), so content detected at severity levels low, medium, or high is filtered.
77-
78-
The configurability feature allows customers to adjust the settings, separately for prompts and completions, to filter content for each content category at different severity levels as described in the table below:
79-
80-
| Severity filtered | Configurable for prompts | Configurable for completions | Descriptions |
81-
|-------------------|--------------------------|------------------------------|--------------|
82-
| Low, medium, high | Yes | Yes | Strictest filtering configuration. Content detected at severity levels low, medium and high is filtered.|
83-
| Medium, high | Yes | Yes | Content detected at severity level low isn't filtered, content at medium and high is filtered.|
84-
| High | Yes| Yes | Content detected at severity levels low and medium isn't filtered. Only content at severity level high is filtered. Requires approval<sup>1</sup>.|
85-
| No filters | If approved<sup>1</sup>| If approved<sup>1</sup>| No content is filtered regardless of severity level detected. Requires approval<sup>1</sup>.|
86-
87-
<sup>1</sup> For Azure OpenAI models, only customers who have been approved for modified content filtering have full content filtering control, including configuring content filters at severity level high only or turning off content filters. Apply for modified content filters via these forms: [Azure OpenAI Limited Access Review: Modified Content Filters](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUMlBQNkZMR0lFRldORTdVQzQ0TEI5Q1ExOSQlQCN0PWcu), and [Modified Abuse Monitoring](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUOE9MUTFMUlpBNk5IQlZWWkcyUEpWWEhGOCQlQCN0PWcu).
88-
89-
Customers are responsible for ensuring that applications integrating Azure OpenAI comply with the [Code of Conduct](/legal/ai-code-of-conduct?context=%2Fazure%2Fai-services%2Fopenai%2Fcontext%2Fcontext).
76+
[!INCLUDE [content-filter-configurability](../../ai-services/openai/includes/content-filter-configurability.md)]
9077

9178

9279
## Related content

articles/ai-foundry/how-to/evaluation-github-action.md

Lines changed: 57 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: How to run evaluation in GitHub Action to streamline the evaluation
55
manager: scottpolly
66
ms.service: azure-ai-foundry
77
ms.topic: how-to
8-
ms.date: 05/19/2025
8+
ms.date: 06/1/2025
99
ms.reviewer: hanch
1010
ms.author: lagayhar
1111
author: lgayhardt
@@ -27,7 +27,7 @@ Offline evaluation involves testing AI models and agents using test datasets to
2727

2828
## Prerequisites
2929

30-
[!INCLUDE [hub-only-prereq](../includes/hub-only-prereq.md)]
30+
Foundry project or Hubs based project. To learn more, see [Create a project](create-projects.md).
3131

3232
Two GitHub Actions are available for evaluating AI applications: **ai-agent-evals** and **genai-evals**.
3333

@@ -45,8 +45,16 @@ The input of ai-agent-evals includes:
4545

4646
**Required:**
4747

48-
- `azure-aiproject-connection-string`: The connection string for the Azure AI project. This is used to connect to Azure OpenAI to simulate conversations with each agent, and to connect to the Azure AI evaluation SDK to perform the evaluation.
49-
- `deployment-name`: the deployed model name.
48+
# [Foundry project](#tab/foundry-project)
49+
50+
- `azure-ai-project-endpoint`: The endpoint of the Azure AI project. This is used to connect to your AI project to simulate conversations with each agent, and to connect to the Azure AI evaluation SDK to perform the evaluation.
51+
52+
# [Hub based project](#tab/hub-project)
53+
54+
- `azure-aiproject-connection-string`: The connection string of the Azure AI project. This is used to connect to your AI project to simulate conversations with each agent, and to connect to the Azure AI evaluation SDK to perform the evaluation.
55+
56+
---
57+
- `deployment-name`: the deployed model name for evaluation judgement.
5058
- `data-path`: Path to the input data file containing the conversation starters. Each conversation starter is sent to each agent for a pairwise comparison of evaluation results.
5159
- `evaluators`: built-in evaluator names.
5260
- `data`: a set of conversation starters/queries.
@@ -55,6 +63,7 @@ The input of ai-agent-evals includes:
5563
- When only one `agent-id` is specified, the evaluation results include the absolute values for each metric along with the corresponding confidence intervals.
5664
- When multiple `agent-ids` are specified, the results include absolute values for each agent and a statistical comparison against the designated baseline agent ID.
5765

66+
5867
**Optional:**
5968

6069
- `api-version`: the API version of deployed model.
@@ -92,6 +101,48 @@ To use the GitHub Action, add the GitHub Action to your CI/CD workflows and spec
92101
93102
This example illustrates how Azure Agent AI Evaluation can be run when comparing different agents with agent IDs.
94103

104+
# [Foundry project](#tab/foundry-project)
105+
106+
```YAML
107+
name: "AI Agent Evaluation"
108+
109+
on:
110+
workflow_dispatch:
111+
push:
112+
branches:
113+
- main
114+
115+
permissions:
116+
id-token: write
117+
contents: read
118+
119+
jobs:
120+
run-action:
121+
runs-on: ubuntu-latest
122+
steps:
123+
- name: Checkout
124+
uses: actions/checkout@v4
125+
126+
- name: Azure login using Federated Credentials
127+
uses: azure/login@v2
128+
with:
129+
client-id: ${{ vars.AZURE_CLIENT_ID }}
130+
tenant-id: ${{ vars.AZURE_TENANT_ID }}
131+
subscription-id: ${{ vars.AZURE_SUBSCRIPTION_ID }}
132+
133+
- name: Run Evaluation
134+
uses: microsoft/ai-agent-evals@v2-beta
135+
with:
136+
# Replace placeholders with values for your Azure AI Project
137+
azure-ai-project-endpoint: "<your-ai-project-endpoint>"
138+
deployment-name: "<your-deployment-name>"
139+
agent-ids: "<your-ai-agent-ids>"
140+
data-path: ${{ github.workspace }}/path/to/your/data-file
141+
142+
```
143+
144+
# [Hub based project](#tab/hub-project)
145+
95146
```YAML
96147
name: "AI Agent Evaluation"
97148

@@ -130,6 +181,8 @@ jobs:
130181

131182
```
132183

184+
---
185+
133186
### AI agent evaluations output
134187

135188
Evaluation results are outputted to the summary section for each AI evaluation GitHub Action run under Actions in GitHub.com.

articles/ai-foundry/how-to/use-blocklists.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-ai-foundry
77
ms.custom:
88
- ignite-2024
99
ms.topic: how-to
10-
ms.date: 05/01/2025
10+
ms.date: 05/31/2025
1111
ms.author: pafarley
1212
author: PatrickFarley
1313
---

articles/ai-foundry/index.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,7 @@ productDirectory:
104104
text: Speech
105105
- url: ../ai-services/computer-vision/index.yml
106106
text: Vision
107-
- url: ../ai-services/custom-vision-service/index.yml
107+
- url: ../ai-services/translator/index.yml
108108
text: Translator
109109
- url: ../ai-services/language-service/index.yml
110110
text: Language

articles/ai-foundry/responsible-use-of-ai-overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ manager: nitinme
66
keywords: Azure AI services, cognitive
77
ms.service: azure-ai-foundry
88
ms.topic: overview
9-
ms.date: 05/09/2025
9+
ms.date: 05/31/2025
1010
ms.author: pafarley
1111
author: PatrickFarley
1212
ms.custom: ignite-2024
Lines changed: 9 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -1,39 +1,22 @@
11
---
2-
title: "Azure AI Foundry docs: What's new for April 2025"
3-
description: "What's new in the Azure AI Foundry docs for April 2025."
2+
title: "Azure AI Foundry docs: What's new for May 2025"
3+
description: "What's new in the Azure AI Foundry docs for May 2025."
44
ms.author: smcdowell
55
author: skpmcdowell
66
ms.topic: whats-new
7-
ms.subject: ai-studio
8-
ms.custom: April-2025
9-
ms.date: 05/03/2025
7+
ms.subject: ai-foundry
8+
ms.custom: May-2025
9+
ms.date: 06/02/2025
1010
---
1111

12-
# Azure AI Foundry docs: What's new for April 2025
12+
# Azure AI Foundry docs: What's new for May 2025
1313

14-
Welcome to what's new in the Azure AI Foundry docs for April 2025. This article lists some of the major changes to docs during this period.
14+
Welcome to what's new in the Azure AI Foundry docs for May 2025. This article lists some of the major changes to docs during this period.
1515

16+
## Updated articles
1617

17-
## Azure AI Foundry
18+
- [Evaluate your Generative AI application on the cloud with Azure AI Projects SDK (preview)](../ai-foundry/how-to/develop/cloud-evaluation.md)
1819

19-
### New articles
20-
21-
- [AI Red Teaming Agent (preview)](../ai-foundry/concepts/ai-red-teaming-agent.md)
22-
- [Evaluate your AI agents locally with Azure AI Evaluation SDK (preview)](../ai-foundry/how-to/develop/agent-evaluate-sdk.md)
23-
- [How to use structured outputs for chat models](../ai-foundry/model-inference/how-to/use-structured-outputs.md)
24-
- [Run automated safety scans with AI Red Teaming Agent (preview)](../ai-foundry/how-to/develop/run-scans-ai-red-teaming-agent.md)
25-
- [Work with Azure AI Agent Service in Visual Studio Code (Preview)](../ai-foundry/how-to/develop/vs-code-agents.md)
26-
- [Work with the Azure AI Foundry for Visual Studio Code extension (Preview)](../ai-foundry/how-to/develop/get-started-projects-vs-code.md)
27-
28-
29-
### Updated articles
30-
31-
- [Evaluate your AI agents locally with Azure AI Evaluation SDK (preview)](../ai-foundry/how-to/develop/agent-evaluate-sdk.md)
32-
- [Evaluate your Generative AI application locally with the Azure AI Evaluation SDK](../ai-foundry/how-to/develop/evaluate-sdk.md)
33-
- [Evaluation and monitoring metrics for generative AI](../ai-foundry/concepts/evaluation-metrics-built-in.md)
34-
- [Fine-tune models using standard deployments in Azure AI Foundry](../ai-foundry/how-to/fine-tune-serverless.md)
35-
- [How to configure a private link for Azure AI Foundry hubs](../ai-foundry/how-to/configure-private-link.md)
36-
- [How to use MedImageParse healthcare AI models for segmentation of medical images](../ai-foundry/how-to/healthcare-ai/deploy-medimageparse.md)
3720

3821

3922

articles/ai-services/agents/how-to/tools/logic-apps.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -143,4 +143,4 @@ print("Deleted agent")
143143

144144
## Next steps
145145

146-
[See the full sample for Logic Apps integration.](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-projects/samples/agents/sample_agents_logic_apps.py)
146+
[See the full sample for Logic Apps integration.](https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/ai/azure-ai-agents/samples/agents_tools/sample_agents_logic_apps.py)

articles/ai-services/computer-vision/concept-face-recognition.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.subservice: azure-ai-face
1010
ms.custom:
1111
- ignite-2023
1212
ms.topic: conceptual
13-
ms.date: 05/01/2025
13+
ms.date: 05/31/2025
1414
ms.author: pafarley
1515
feedback_help_link_url: https://learn.microsoft.com/answers/tags/156/azure-face
1616
---

articles/ai-services/computer-vision/concept-object-detection-40.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,9 @@ manager: nitinme
77

88
ms.service: azure-ai-vision
99
ms.topic: conceptual
10-
ms.date: 05/01/2025
10+
ms.date: 05/31/2025
1111
ms.author: pafarley
12+
ms.collection: "ce-skilling-fresh-tier2, ce-skilling-ai-copilot"
1213
---
1314

1415
# Object detection (version 4.0)

0 commit comments

Comments
 (0)