Skip to content

Commit c17a49e

Browse files
committed
Resolve merge conflict: move new Azure OpenAI TOC structure to SDK + API Reference section
2 parents 2888fc1 + 98b248d commit c17a49e

File tree

76 files changed

+9942
-2464
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

76 files changed

+9942
-2464
lines changed

articles/ai-foundry/agents/concepts/model-region-support.md

Lines changed: 92 additions & 21 deletions
Large diffs are not rendered by default.

articles/ai-foundry/agents/how-to/tools/file-search.md

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,10 @@ services: cognitive-services
66
manager: nitinme
77
ms.service: azure-ai-agent-service
88
ms.topic: how-to
9-
ms.date: 07/17/2025
9+
ms.date: 08/01/2025
1010
author: aahill
1111
ms.author: aahi
12-
ms.custom: azure-ai-agents
12+
ms.custom: azure-ai-agents, references_regions
1313
---
1414

1515
# Azure AI Foundry Agent Service file search tool
@@ -30,6 +30,11 @@ File search augments agents with knowledge from outside its model, such as propr
3030

3131
### Usage support
3232

33+
> [!NOTE]
34+
> The file search tool is currently unavailable in the following regions:
35+
> * Italy north
36+
> * Brazil south
37+
3338
|Azure AI foundry support | Python SDK | C# SDK | JavaScript SDK | REST API | Basic agent setup | Standard agent setup |
3439
|---------|---------|---------|---------|---------|---------|---------|
3540
| ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | File upload only | File upload and using bring-your-own blob storage |
@@ -74,7 +79,7 @@ Vector store objects give the file search tool the ability to search your files.
7479
Similarly, these files can be removed from a vector store by either:
7580

7681
* Deleting the vector store file object or,
77-
* By deleting the underlying file object, which removes the file it from all vector_store and code_interpreter configurations across all agents and threads in your organization
82+
* By deleting the underlying file object, which removes the file from all vector_store and code_interpreter configurations across all agents and threads in your organization
7883

7984
The maximum file size is 512 MB. Each file should contain no more than 5,000,000 tokens per file (computed automatically when you attach a file).
8085

articles/ai-foundry/agents/how-to/virtual-networks.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ services: cognitive-services
66
manager: nitinme
77
ms.service: azure-ai-agent-service
88
ms.topic: how-to
9-
ms.date: 05/12/2025
9+
ms.date: 08/01/2025
1010
author: aahill
1111
ms.author: aahi
1212
ms.reviewer: fosteramanda
@@ -15,7 +15,7 @@ ms.custom: azure-ai-agents
1515

1616
# Create a new network-secured environment with user-managed identity
1717

18-
Azure AI Foundry Agent Service offers **Standard Setup with private networking** environment setup, allowing you to bring your own (BYO) private virtual network. This set up creates an isolated network environment that lets you securely access data and perform actions while maintaining full control over your network infrastructure. This guide provides a step-by-step walkthrough of the setup process and outlines all necessary requirements.
18+
Azure AI Foundry Agent Service offers **Standard Setup with private networking** environment setup, allowing you to bring your own (BYO) private virtual network. This setup creates an isolated network environment that lets you securely access data and perform actions while maintaining full control over your network infrastructure. This guide provides a step-by-step walkthrough of the setup process and outlines all necessary requirements.
1919

2020
## Security features
2121

@@ -39,7 +39,7 @@ For customers without an existing virtual network, the Standard Setup with Priva
3939
- **Exception:** You may connect your Foundry Project to models deployed in a different region (on another AI Foundry or Azure OpenAI resource) by configuring an appropriate AI Services connection on the Project's [capability host](/azure/templates/microsoft.cognitiveservices/accounts/projects/capabilityhosts).
4040
- **Region availability**:
4141
- For supported regions for Foundry workspace resources, see: [Azure AI Foundry project region availability](../../reference/region-support.md#azure-ai-foundry-projects).
42-
- For supported regions for model deployments, see: [Azure OpenAI model region support](../concepts/model-region-support.md#azure-openai-models).
42+
- For supported regions for model deployments, see: [Azure OpenAI model region support](../concepts/model-region-support.md#available-models).
4343
- **Azure Blob Storage**: using Azure Blob Storage files with the File Search tool isn't supported.
4444

4545
## Prerequisites
@@ -79,7 +79,7 @@ For customers without an existing virtual network, the Standard Setup with Priva
7979
## Configure a new network-secured environment
8080

8181
> [!NOTE]
82-
> - Programmatic deployment is required to set up a network-secured environment for Azure AI Foundry Agent Service. Deployment through the Azure portal is currently not supported.
82+
> - Programmatic deployment is required to setup a network-secured environment for Azure AI Foundry Agent Service. Deployment through the Azure portal is currently not supported.
8383
> - If you want to delete your Foundry resource and Standard Agent with secured network set-up, delete your AI Foundry resource and virtual network last. Before deleting the virtual network, ensure to delete and [purge](../../../ai-services/recover-purge-resources.md#purge-a-deleted-resource) your AI Foundry resource.
8484
> - In the Standard Setup, agents use customer-owned, single-tenant resources. You have full control and visibility over these resources, but you incur costs based on your usage.
8585

@@ -119,7 +119,7 @@ The following DNS zones are configured:
119119
Virtual networks enable you to specify which endpoints can make API calls to your resources. The Azure service automatically rejects API calls from devices outside your defined network. You can establish allowed networks using either formula-based definitions or by creating an exhaustive list of permitted endpoints. This security layer can be combined with other security measures for enhanced protection.
120120

121121
> [!NOTE]
122-
> If you bring your existing virtual network and subnet with the *Microsoft.App/environments* delegation, the minimize size of your subnet should be /27 (32 addresses). We recommend a subnet size of /24 (256 addresses) and is the default subnet size set in the network secured template.
122+
> If you bring your existing virtual network and subnet with the *Microsoft.App/environments* delegation, the minimize size of your subnet should be /27 (32 addresses). We recommend a subnet size of /24 (256 addresses), which is the default subnet size set in the network secured template.
123123

124124
### Network rules
125125

@@ -169,7 +169,7 @@ Once your template deployment is complete, you can access your Foundry project b
169169

170170
This setup enables AI agents to operate entirely within a dedicated, isolated virtual network. By leveraging private network isolation (BYO VNet), organizations can enforce custom security policies, ensuring that AI agents operate within their trusted infrastructure.
171171

172-
Our goal is to accelerate the development and deployment of AI agents without compromising critical security requirements. With our bicep and ARM templates, you can quickly set up your agent environment while still maintaining full control over their networking and data.
172+
Our goal is to accelerate the development and deployment of AI agents without compromising critical security requirements. With our bicep and ARM templates, you can quickly setup your agent environment while still maintaining full control over their networking and data.
173173

174174

175175
## What's next?

articles/ai-foundry/agents/whats-new.md

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,23 @@ author: aahill
77
ms.author: aahi
88
ms.service: azure-ai-agent-service
99
ms.topic: overview
10-
ms.date: 06/26/2025
10+
ms.date: 08/04/2025
1111
ms.custom: azure-ai-agents
1212
---
1313

1414
# What's new in Azure AI Foundry Agent Service
1515

1616
This article provides a summary of the latest releases and major documentation updates for Azure AI Foundry Agent Service.
1717

18+
## August 2025
19+
20+
### New regional availability
21+
22+
The Azure AI Foundry Agent Sevice is now available in the following [regions](./concepts/model-region-support.md#available-models):
23+
* Brazil south
24+
* Germany west central
25+
* Italy north
26+
* South central US
1827
## June 2025
1928

2029
### Deep Research tool

articles/ai-foundry/concepts/observability.md

Lines changed: 57 additions & 49 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: lgayhardt
66
ms.author: lagayhar
77
manager: scottpolly
88
ms.reviewer: mithigpe
9-
ms.date: 05/19/2025
9+
ms.date: 07/31/2025
1010
ms.service: azure-ai-foundry
1111
ms.topic: concept-article
1212
ms.custom:
@@ -32,71 +32,79 @@ This is where evaluators become essential. These specialized tools measure both
3232

3333
Evaluators are specialized tools that measure the quality, safety, and reliability of AI responses. By implementing systematic evaluations throughout the AI development lifecycle, teams can identify and address potential issues before they impact users. The following supported evaluators provide comprehensive assessment capabilities across different AI application types and concerns:
3434

35+
### General purpose
3536

36-
[**RAG (Retrieval Augmented Generation)**:](./evaluation-evaluators/rag-evaluators.md)
37+
| Evaluator | Purpose | Inputs |
38+
|--|--|--|
39+
| Coherence | Measures logical consistency and flow of responses.| Query, response |
40+
| Fluency | Measures natural language quality and readability. | Response |
41+
| QA | Measures comprehensively various quality aspects in question-answering.| Query, context, response, ground truth |
3742

38-
| Evaluator | Purpose |
39-
|--|--|
40-
| Retrieval | Measures how effectively the system retrieves relevant information. |
41-
| Document Retrieval | Measures accuracy in retrieval results given ground truth. |
42-
| Groundedness | Measures how consistent the response is with respect to the retrieved context. |
43-
| Groundedness Pro | Measures whether the response is consistent with respect to the retrieved context. |
44-
| Relevance | Measures how relevant the response is with respect to the query. |
45-
| Response Completeness | Measures to what extent the response is complete (not missing critical information) with respect to the ground truth. |
43+
To learn more, see [General purpose evaluators](./evaluation-evaluators/general-purpose-evaluators.md).
4644

45+
### Textual similarity
4746

48-
[**Agents (preview):**](./evaluation-evaluators/agent-evaluators.md)
47+
| Evaluator | Purpose | Inputs |
48+
|--|--|--|
49+
| Similarity | AI-assisted textual similarity measurement. | Query, context, ground truth |
50+
| F1 Score | Harmonic mean of precision and recall in token overlaps between response and ground truth. | Response, ground truth |
51+
| BLEU | Bilingual Evaluation Understudy score for translation quality measures overlaps in n-grams between response and ground truth. | Response, ground truth |
52+
| GLEU | Google-BLEU variant for sentence-level assessment measures overlaps in n-grams between response and ground truth. | Response, ground truth |
53+
| ROUGE | Recall-Oriented Understudy for Gisting Evaluation measures overlaps in n-grams between response and ground truth. | Response, ground truth |
54+
| METEOR | Metric for Evaluation of Translation with Explicit Ordering measures overlaps in n-grams between response and ground truth. | Response, ground truth |
4955

50-
| Evaluator | Purpose |
51-
|--|--|
52-
| Intent Resolution | Measures how accurately the agent identifies and addresses user intentions.|
53-
| Task Adherence | Measures how well the agent follows through on identified tasks. |
54-
| Tool Call Accuracy | Measures how well the agent selects and calls the correct tools to.|
56+
To learn more, see [Textual similarity evaluators](./evaluation-evaluators/textual-similarity-evaluators.md)
5557

58+
### RAG (retrieval augmented generation)
5659

57-
[**General Purpose:**](./evaluation-evaluators/general-purpose-evaluators.md)
60+
| Evaluator | Purpose | Inputs |
61+
|--|--|--|
62+
| Retrieval | Measures how effectively the system retrieves relevant information. | Query , context |
63+
| Document Retrieval | Measures accuracy in retrieval results given ground truth. | Ground truth , retrieved documents, |
64+
| Groundedness | Measures how consistent the response is with respect to the retrieved context. | Query (optional), context, response |
65+
| Groundedness Pro | Measures whether the response is consistent with respect to the retrieved context. | Query, context, response |
66+
| Relevance | Measures how relevant the response is with respect to the query. | Query, response|
67+
| Response Completeness | Measures to what extent the response is complete (not missing critical information) with respect to the ground truth. | Response, ground truth |
5868

59-
| Evaluator | Purpose |
60-
|--|--|
61-
| Fluency | Measures natural language quality and readability. |
62-
| Coherence | Measures logical consistency and flow of responses.|
63-
| QA | Measures comprehensively various quality aspects in question-answering.|
69+
To learn more, see [Retrieval-augmented Generation (RAG) evaluators](./evaluation-evaluators/rag-evaluators.md).
6470

71+
### Safety and security (preview)
6572

66-
[**Safety and Security (preview):**](./evaluation-evaluators/risk-safety-evaluators.md)
73+
| Evaluator | Purpose | Inputs |
74+
|--|--|--|
75+
| Hate and Unfairness | Identifies biased, discriminatory, or hateful content. | Query, response |
76+
| Sexual | Identifies inappropriate sexual content. | Query, response |
77+
| Violence | Detects violent content or incitement. | Query, response |
78+
| Self-Harm | Detects content promoting or describing self-harm.| Query, response |
79+
| Content Safety | Comprehensive assessment of various safety concerns. | Query, response |
80+
| Protected Materials | Detects unauthorized use of copyrighted or protected content. | Query, response |
81+
| Code Vulnerability | Identifies security issues in generated code. | Query, response |
82+
| Ungrounded Attributes | Detects fabricated or hallucinated information inferred from user interactions. | Query, context, response |
6783

68-
| Evaluator | Purpose |
69-
|--|--|
70-
| Violence | Detects violent content or incitement. |
71-
| Sexual | Identifies inappropriate sexual content. |
72-
| Self-Harm | Detects content promoting or describing self-harm.|
73-
| Hate and Unfairness | Identifies biased, discriminatory, or hateful content. |
74-
| Ungrounded Attributes | Detects fabricated or hallucinated information inferred from user interactions. |
75-
| Code Vulnerability | Identifies security issues in generated code. |
76-
| Protected Materials | Detects unauthorized use of copyrighted or protected content. |
77-
| Content Safety | Comprehensive assessment of various safety concerns. |
84+
To learn more, see [Risk and safety evaluators](./evaluation-evaluators/risk-safety-evaluators.md).
7885

86+
### Agents (preview)
7987

80-
[**Textual Similarity:**](./evaluation-evaluators/textual-similarity-evaluators.md)
88+
| Evaluator | Purpose | Inputs |
89+
|--|--|--|
90+
| Intent Resolution | Measures how accurately the agent identifies and addresses user intentions.| Query, response |
91+
| Task Adherence | Measures how well the agent follows through on identified tasks. | Query, response, tool definitions (optional) |
92+
| Tool Call Accuracy | Measures how well the agent selects and calls the correct tools to.| Query, either response or tool calls, tool definitions |
8193

82-
| Evaluator | Purpose |
83-
|--|--|
84-
| Similarity | AI-assisted textual similarity measurement. |
85-
| F1 Score | Harmonic mean of precision and recall in token overlaps between response and ground truth. |
86-
| BLEU | Bilingual Evaluation Understudy score for translation quality measures overlaps in n-grams between response and ground truth. |
87-
| GLEU | Google-BLEU variant for sentence-level assessment measures overlaps in n-grams between response and ground truth. |
88-
| ROUGE | Recall-Oriented Understudy for Gisting Evaluation measures overlaps in n-grams between response and ground truth. |
89-
| METEOR | Metric for Evaluation of Translation with Explicit Ordering measures overlaps in n-grams between response and ground truth. |
94+
To learn more, see [Agent evaluators](./evaluation-evaluators/agent-evaluators.md).
9095

96+
### Azure OpenAI graders (preview)
9197

92-
[**Azure OpenAI Graders (preview):**](./evaluation-evaluators/azure-openai-graders.md)
98+
| Evaluator | Purpose | Inputs |
99+
|--|--|--|
100+
| Model Labeler| Classifies content using custom guidelines and labels. | Query, response, ground truth |
101+
| String Checker | Performs flexible text validations and pattern matching. | Response |
102+
| Text Similarity | Evaluates the quality of text or determine semantic closeness. | Response, ground truth |
103+
| Model Scorer| Generates numerical scores (customized range) for content based on custom guidelines. | Query, response, ground truth |
93104

94-
| Evaluator | Purpose |
95-
|--|--|
96-
| Model Labeler | Classifies content using custom guidelines and labels. |
97-
| Model Scorer | Generates numerical scores (customized range) for content based on custom guidelines. |
98-
| String Checker | Performs flexible text validations and pattern matching. |
99-
| Textual Similarity | Evaluates the quality of text or determine semantic closeness. |
105+
To learn more, see [Azure OpenAI Graders](./evaluation-evaluators/azure-openai-graders.md).
106+
107+
### Evaluators in the development lifecycle
100108

101109
By using these evaluators strategically throughout the development lifecycle, teams can build more reliable, safe, and effective AI applications that meet user needs while minimizing potential risks.
102110

articles/ai-foundry/foundry-models/concepts/models.md

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.author: mopeakande
77
manager: scottpolly
88
reviewer: santiagxf
99
ms.reviewer: fasantia
10-
ms.date: 07/11/2025
10+
ms.date: 08/04/2025
1111
ms.service: azure-ai-model-inference
1212
ms.topic: how-to
1313
ms.custom:
@@ -58,6 +58,17 @@ Azure OpenAI in Azure AI Foundry Models offers a diverse set of models with diff
5858

5959
See [this model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=aoai).
6060

61+
### Black Forest Labs models sold directly by Azure
62+
63+
The Black Forest Labs collection of image generation models include FLUX.1 Kontext [pro] for in-context generation and editing and FLUX1.1 [pro] for text-to-image generation.
64+
65+
| Model | Type | Capabilities | Project type |
66+
| ------ | ---- | ------------ | ------------ |
67+
| [FLUX.1-Kontext-pro](https://ai.azure.com/explore/models/FLUX.1-Kontext-pro/version/1/registry/azureml-blackforestlabs) | Image generation | - **Input:** text and image (5000 tokens and 1 image) <br /> - **Output:** One Image <br /> - **Tool calling:** No <br /> - **Response formats**: Image (PNG and JPG) | Foundry, Hub-based |
68+
| [FLUX-1.1-pro](https://ai.azure.com/explore/models/FLUX-1.1-pro/version/1/registry/azureml-blackforestlabs) | Image generation | - **Input:** text (5000 tokens) <br /> - **Output:** One Image <br /> - **Tool calling:** No <br /> - **Response formats:** Image (PNG and JPG) | Hub-based |
69+
70+
71+
See [this model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=Black+Forest+Labs).
6172

6273
### DeepSeek models sold directly by Azure
6374

articles/ai-foundry/how-to/continuous-evaluation-agents.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -45,8 +45,8 @@ import os, json
4545
from azure.ai.projects import AIProjectClient
4646
from azure.identity import DefaultAzureCredential
4747

48-
project_client = AIProjectClient.from_connection_string(
49-
credential=DefaultAzureCredential(), conn_str=os.environ["PROJECT_CONNECTION_STRING"]
48+
project_client = AIProjectClient(
49+
credential=DefaultAzureCredential(), endpoint=os.environ["PROJECT_ENDPOINT"]
5050
)
5151

5252
agent = project_client.agents.create_agent(
@@ -95,7 +95,7 @@ project_client.evaluation.create_agent_evaluation(
9595
thread=thread.id,
9696
run=run.id,
9797
evaluators=evaluators,
98-
appInsightsConnectionString = project_client.telemetry.get_connection_string(),
98+
appInsightsConnectionString = project_client.telemetry.get_application_insights_connection_string(),
9999
)
100100
)
101101

@@ -189,7 +189,7 @@ project_client.evaluation.create_agent_evaluation(
189189
run=run.id,
190190
evaluators=evaluators,
191191
samplingConfiguration = sampling_config,
192-
appInsightsConnectionString = project_client.telemetry.get_connection_string(),
192+
appInsightsConnectionString = project_client.telemetry.get_application_insights_connection_string(),
193193
)
194194
)
195195
```

0 commit comments

Comments
 (0)