You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | File upload only | File upload and using bring-your-own blob storage |
@@ -74,7 +79,7 @@ Vector store objects give the file search tool the ability to search your files.
74
79
Similarly, these files can be removed from a vector store by either:
75
80
76
81
* Deleting the vector store file object or,
77
-
* By deleting the underlying file object, which removes the file it from all vector_store and code_interpreter configurations across all agents and threads in your organization
82
+
* By deleting the underlying file object, which removes the file from all vector_store and code_interpreter configurations across all agents and threads in your organization
78
83
79
84
The maximum file size is 512 MB. Each file should contain no more than 5,000,000 tokens per file (computed automatically when you attach a file).
Copy file name to clipboardExpand all lines: articles/ai-foundry/agents/how-to/virtual-networks.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ services: cognitive-services
6
6
manager: nitinme
7
7
ms.service: azure-ai-agent-service
8
8
ms.topic: how-to
9
-
ms.date: 05/12/2025
9
+
ms.date: 08/01/2025
10
10
author: aahill
11
11
ms.author: aahi
12
12
ms.reviewer: fosteramanda
@@ -15,7 +15,7 @@ ms.custom: azure-ai-agents
15
15
16
16
# Create a new network-secured environment with user-managed identity
17
17
18
-
Azure AI Foundry Agent Service offers **Standard Setup with private networking** environment setup, allowing you to bring your own (BYO) private virtual network. This set up creates an isolated network environment that lets you securely access data and perform actions while maintaining full control over your network infrastructure. This guide provides a step-by-step walkthrough of the setup process and outlines all necessary requirements.
18
+
Azure AI Foundry Agent Service offers **Standard Setup with private networking** environment setup, allowing you to bring your own (BYO) private virtual network. This setup creates an isolated network environment that lets you securely access data and perform actions while maintaining full control over your network infrastructure. This guide provides a step-by-step walkthrough of the setup process and outlines all necessary requirements.
19
19
20
20
## Security features
21
21
@@ -39,7 +39,7 @@ For customers without an existing virtual network, the Standard Setup with Priva
39
39
-**Exception:** You may connect your Foundry Project to models deployed in a different region (on another AI Foundry or Azure OpenAI resource) by configuring an appropriate AI Services connection on the Project's [capability host](/azure/templates/microsoft.cognitiveservices/accounts/projects/capabilityhosts).
40
40
-**Region availability**:
41
41
- For supported regions for Foundry workspace resources, see: [Azure AI Foundry project region availability](../../reference/region-support.md#azure-ai-foundry-projects).
42
-
- For supported regions for model deployments, see: [Azure OpenAI model region support](../concepts/model-region-support.md#azure-openai-models).
42
+
- For supported regions for model deployments, see: [Azure OpenAI model region support](../concepts/model-region-support.md#available-models).
43
43
-**Azure Blob Storage**: using Azure Blob Storage files with the File Search tool isn't supported.
44
44
45
45
## Prerequisites
@@ -79,7 +79,7 @@ For customers without an existing virtual network, the Standard Setup with Priva
79
79
## Configure a new network-secured environment
80
80
81
81
> [!NOTE]
82
-
> - Programmatic deployment is required to set up a network-secured environment for Azure AI Foundry Agent Service. Deployment through the Azure portal is currently not supported.
82
+
> - Programmatic deployment is required to setup a network-secured environment for Azure AI Foundry Agent Service. Deployment through the Azure portal is currently not supported.
83
83
> - If you want to delete your Foundry resource and Standard Agent with secured network set-up, delete your AI Foundry resource and virtual network last. Before deleting the virtual network, ensure to delete and [purge](../../../ai-services/recover-purge-resources.md#purge-a-deleted-resource) your AI Foundry resource.
84
84
> - In the Standard Setup, agents use customer-owned, single-tenant resources. You have full control and visibility over these resources, but you incur costs based on your usage.
85
85
@@ -119,7 +119,7 @@ The following DNS zones are configured:
119
119
Virtual networks enable you to specify which endpoints can make API calls to your resources. The Azure service automatically rejects API calls from devices outside your defined network. You can establish allowed networks using either formula-based definitions or by creating an exhaustive list of permitted endpoints. This security layer can be combined with other security measures for enhanced protection.
120
120
121
121
> [!NOTE]
122
-
> If you bring your existing virtual network and subnet with the *Microsoft.App/environments* delegation, the minimize size of your subnet should be /27 (32 addresses). We recommend a subnet size of /24 (256 addresses) and is the default subnet size setin the network secured template.
122
+
> If you bring your existing virtual network and subnet with the *Microsoft.App/environments* delegation, the minimize size of your subnet should be /27 (32 addresses). We recommend a subnet size of /24 (256 addresses), which is the default subnet size setin the network secured template.
123
123
124
124
### Network rules
125
125
@@ -169,7 +169,7 @@ Once your template deployment is complete, you can access your Foundry project b
169
169
170
170
This setup enables AI agents to operate entirely within a dedicated, isolated virtual network. By leveraging private network isolation (BYO VNet), organizations can enforce custom security policies, ensuring that AI agents operate within their trusted infrastructure.
171
171
172
-
Our goal is to accelerate the development and deployment of AI agents without compromising critical security requirements. With our bicep and ARM templates, you can quickly set up your agent environment while still maintaining full control over their networking and data.
172
+
Our goal is to accelerate the development and deployment of AI agents without compromising critical security requirements. With our bicep and ARM templates, you can quickly setup your agent environment while still maintaining full control over their networking and data.
Copy file name to clipboardExpand all lines: articles/ai-foundry/concepts/observability.md
+57-49Lines changed: 57 additions & 49 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ author: lgayhardt
6
6
ms.author: lagayhar
7
7
manager: scottpolly
8
8
ms.reviewer: mithigpe
9
-
ms.date: 05/19/2025
9
+
ms.date: 07/31/2025
10
10
ms.service: azure-ai-foundry
11
11
ms.topic: concept-article
12
12
ms.custom:
@@ -32,71 +32,79 @@ This is where evaluators become essential. These specialized tools measure both
32
32
33
33
Evaluators are specialized tools that measure the quality, safety, and reliability of AI responses. By implementing systematic evaluations throughout the AI development lifecycle, teams can identify and address potential issues before they impact users. The following supported evaluators provide comprehensive assessment capabilities across different AI application types and concerns:
| F1 Score | Harmonic mean of precision and recall in token overlaps between response and ground truth. | Response, ground truth |
51
+
| BLEU | Bilingual Evaluation Understudy score for translation quality measures overlaps in n-grams between response and ground truth. | Response, ground truth |
52
+
| GLEU | Google-BLEU variant for sentence-level assessment measures overlaps in n-grams between response and ground truth. | Response, ground truth |
53
+
| ROUGE | Recall-Oriented Understudy for Gisting Evaluation measures overlaps in n-grams between response and ground truth. | Response, ground truth |
54
+
| METEOR | Metric for Evaluation of Translation with Explicit Ordering measures overlaps in n-grams between response and ground truth. | Response, ground truth |
49
55
50
-
| Evaluator | Purpose |
51
-
|--|--|
52
-
| Intent Resolution | Measures how accurately the agent identifies and addresses user intentions.|
53
-
| Task Adherence | Measures how well the agent follows through on identified tasks. |
54
-
| Tool Call Accuracy | Measures how well the agent selects and calls the correct tools to.|
56
+
To learn more, see [Textual similarity evaluators](./evaluation-evaluators/textual-similarity-evaluators.md)
| Retrieval | Measures how effectively the system retrieves relevant information. | Query , context |
63
+
| Document Retrieval | Measures accuracy in retrieval results given ground truth. | Ground truth , retrieved documents, |
64
+
| Groundedness | Measures how consistent the response is with respect to the retrieved context. | Query (optional), context, response |
65
+
| Groundedness Pro | Measures whether the response is consistent with respect to the retrieved context. | Query, context, response |
66
+
| Relevance | Measures how relevant the response is with respect to the query. | Query, response|
67
+
| Response Completeness | Measures to what extent the response is complete (not missing critical information) with respect to the ground truth. | Response, ground truth |
58
68
59
-
| Evaluator | Purpose |
60
-
|--|--|
61
-
| Fluency | Measures natural language quality and readability. |
62
-
| Coherence | Measures logical consistency and flow of responses.|
63
-
| QA | Measures comprehensively various quality aspects in question-answering.|
69
+
To learn more, see [Retrieval-augmented Generation (RAG) evaluators](./evaluation-evaluators/rag-evaluators.md).
64
70
71
+
### Safety and security (preview)
65
72
66
-
[**Safety and Security (preview):**](./evaluation-evaluators/risk-safety-evaluators.md)
73
+
| Evaluator | Purpose | Inputs |
74
+
|--|--|--|
75
+
| Hate and Unfairness | Identifies biased, discriminatory, or hateful content. | Query, response |
76
+
| Sexual | Identifies inappropriate sexual content. | Query, response |
| Model Labeler| Classifies content using custom guidelines and labels. | Query, response, ground truth |
101
+
| String Checker | Performs flexible text validations and pattern matching. | Response |
102
+
| Text Similarity | Evaluates the quality of text or determine semantic closeness. | Response, ground truth |
103
+
| Model Scorer| Generates numerical scores (customized range) for content based on custom guidelines. | Query, response, ground truth |
93
104
94
-
| Evaluator | Purpose |
95
-
|--|--|
96
-
| Model Labeler | Classifies content using custom guidelines and labels. |
97
-
| Model Scorer | Generates numerical scores (customized range) for content based on custom guidelines. |
98
-
| String Checker | Performs flexible text validations and pattern matching. |
99
-
| Textual Similarity | Evaluates the quality of text or determine semantic closeness. |
105
+
To learn more, see [Azure OpenAI Graders](./evaluation-evaluators/azure-openai-graders.md).
106
+
107
+
### Evaluators in the development lifecycle
100
108
101
109
By using these evaluators strategically throughout the development lifecycle, teams can build more reliable, safe, and effective AI applications that meet user needs while minimizing potential risks.
Copy file name to clipboardExpand all lines: articles/ai-foundry/foundry-models/concepts/models.md
+12-1Lines changed: 12 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ ms.author: mopeakande
7
7
manager: scottpolly
8
8
reviewer: santiagxf
9
9
ms.reviewer: fasantia
10
-
ms.date: 07/11/2025
10
+
ms.date: 08/04/2025
11
11
ms.service: azure-ai-model-inference
12
12
ms.topic: how-to
13
13
ms.custom:
@@ -58,6 +58,17 @@ Azure OpenAI in Azure AI Foundry Models offers a diverse set of models with diff
58
58
59
59
See [this model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=aoai).
60
60
61
+
### Black Forest Labs models sold directly by Azure
62
+
63
+
The Black Forest Labs collection of image generation models include FLUX.1 Kontext [pro] for in-context generation and editing and FLUX1.1 [pro] for text-to-image generation.
64
+
65
+
| Model | Type | Capabilities | Project type |
66
+
| ------ | ---- | ------------ | ------------ |
67
+
|[FLUX.1-Kontext-pro](https://ai.azure.com/explore/models/FLUX.1-Kontext-pro/version/1/registry/azureml-blackforestlabs)| Image generation | - **Input:** text and image (5000 tokens and 1 image) <br /> - **Output:** One Image <br /> - **Tool calling:** No <br /> - **Response formats**: Image (PNG and JPG) | Foundry, Hub-based |
68
+
|[FLUX-1.1-pro](https://ai.azure.com/explore/models/FLUX-1.1-pro/version/1/registry/azureml-blackforestlabs)| Image generation | - **Input:** text (5000 tokens) <br /> - **Output:** One Image <br /> - **Tool calling:** No <br /> - **Response formats:** Image (PNG and JPG) | Hub-based |
69
+
70
+
71
+
See [this model collection in Azure AI Foundry portal](https://ai.azure.com/explore/models?&selectedCollection=Black+Forest+Labs).
0 commit comments