Skip to content

Commit 0659e58

Browse files
committed
fixes
1 parent a566880 commit 0659e58

File tree

10 files changed

+146
-13
lines changed

10 files changed

+146
-13
lines changed

articles/ai-foundry/agents/concepts/model-region-support.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -22,13 +22,13 @@ Azure OpenAI provides customers with choices on the hosting structure that fits
2222
- **Standard** is offered with a global deployment option, routing traffic globally to provide higher throughput.
2323
- **Provisioned** is also offered with a global deployment option, allowing customers to purchase and deploy provisioned throughput units across Azure global infrastructure.
2424

25-
All deployments can perform the exact same inference operations, however the billing, scale, and performance are substantially different. To learn more about Azure OpenAI deployment types see [deployment types guide](/azure/ai-services/agents/ai-services/openai/how-to/deployment-types).
25+
All deployments can perform the exact same inference operations, however the billing, scale, and performance are substantially different. To learn more about Azure OpenAI deployment types see [deployment types guide](../../../ai-services/openai/how-to/deployment-types.md).
2626

2727
Azure AI Foundry Agent Service supports the following Azure OpenAI models in the listed regions.
2828

2929
> [!NOTE]
30-
> * The following table is for standard deployment availability. For information on Provisioned Throughput Unit (PTU) availability, see [provisioned throughput](/azure/ai-services/agents/ai-services/openai/concepts/provisioned-throughput) in the Azure OpenAI documentation. `GlobalStandard` customers also have access to [global standard models](/azure/ai-services/agents/ai-services/openai/concepts/modelsglobal-standard-model-availability).
31-
> * [Hub based projects](/azure/ai-services/agents/ai-foundry/what-is-azure-ai-foundryproject-types) are limited to the following models: gpt-4o, gpt-4o-mini, gpt-4, gpt-35-turbo
30+
> * The following table is for standard deployment availability. For information on Provisioned Throughput Unit (PTU) availability, see [provisioned throughput](../../../ai-services/openai/concepts/provisioned-throughput.md) in the Azure OpenAI documentation. `GlobalStandard` customers also have access to [global standard models](../../../ai-services/openai/concepts/models.md#global-standard-model-availability).
31+
> * [Hub based projects](../../what-is-azure-ai-foundry.md#project-types) are limited to the following models: gpt-4o, gpt-4o-mini, gpt-4, gpt-35-turbo
3232
3333
| REGION | o1 | o3-mini | gpt-4.1, 2025-04-14 | gpt-4.1-mini, 2025-04-14 | gpt-4.1-nano, 2025-04-14 | gpt-4o, 2024-05-13 | gpt-4o, 2024-08-06 | gpt-4o, 2024-11-20 | gpt-4o-mini, 2024-07-18 | gpt-4, 0613 | gpt-4, turbo-2024-04-09 | gpt-4-32k, 0613 | gpt-35-turbo, 1106 | gpt-35-turbo, 0125 |
3434
|------------------|----|---------|---------------------|--------------------------|--------------------------|--------------------|--------------------|--------------------|-------------------------|-------------|-------------------------|-----------------|--------------------|--------------------|

articles/ai-foundry/agents/faq.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ metadata:
1212
author: aahill
1313
title: Azure AI Foundry Agent Service frequently asked questions
1414
summary: |
15-
If you can't find answers to your questions in this document, and still need help check the [Azure AI services support options guide](/azure/ai-services/agents/ai-services/cognitive-services-support-options). Azure AI Foundry Agent Service is part of Azure AI services.
15+
If you can't find answers to your questions in this document, and still need help check the [Azure AI services support options guide](../../ai-services/cognitive-services-support-options.md). Azure AI Foundry Agent Service is part of Azure AI services.
1616
sections:
1717
- name: General
1818
questions:
Lines changed: 97 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,97 @@
1+
---
2+
title: Monitor Azure AI Foundry Agent Service
3+
description: Start here to learn how to use Azure Monitor to capture and analyze metrics for your Azure AI Foundry Agent Service.
4+
ms.date: 06/02/2025
5+
ms.custom: horz-monitor, subject-monitoring
6+
ms.topic: conceptual
7+
author: aahill
8+
ms.author: aahi
9+
ms.service: azure-ai-agent-service
10+
---
11+
12+
# Monitor Azure AI Foundry Agent Service
13+
14+
[!INCLUDE [horz-monitor-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-intro.md)]
15+
16+
Monitoring is available for agents in a [standard agent setup](../concepts/standard-agent-setup.md).
17+
18+
> [!IMPORTANT]
19+
> Monitoring support is currently limited to Azure AI Foundry hubs. Azure AI Foundry projects are not supported.
20+
21+
## Dashboards
22+
23+
Azure AI Foundry Agent Service provides out-of-box dashboards. There are two key dashboards to monitor your resource:
24+
25+
- The metrics dashboard in the AI Foundry resource view
26+
- The dashboard in the overview pane within the Azure portal
27+
28+
To access the monitoring dashboards, sign in to the [Azure portal](https://portal.azure.com) and then select **Monitoring** in the left navigation menu, then click **Metrics**.
29+
30+
31+
:::image type="content" source="../media/monitoring/dashboard.png" alt-text="Screenshot that shows out-of-box dashboards for a resource in the Azure portal." lightbox="../media/monitoring/dashboard.png" border="false":::
32+
33+
## Azure monitor platform metrics
34+
35+
Azure Monitor provides platform metrics for most services. These metrics are:
36+
37+
* Individually defined for each namespace.
38+
* Stored in the Azure Monitor time-series metrics database.
39+
* Lightweight and capable of supporting near real-time alerting.
40+
* Used to track the performance of a resource over time.
41+
* Collection: Azure Monitor collects platform metrics automatically. No configuration is required.
42+
43+
For a list of all metrics it's possible to gather for all resources in Azure Monitor, see [Supported metrics in Azure Monitor](/azure/azure-monitor/platform/metrics-supported).
44+
45+
## Azure AI Foundry Agent Service metrics
46+
Azure AI Foundry Agent Service has commonality with a subset of Azure AI services. Here's a list of currently available metrics on Azure Monitor:
47+
48+
| **Metric** | **Name in REST API** | **Unit** | **Aggregation** | **Dimensions** | **Time Grains** | **DS Export** |
49+
|-----------------|----------------------|----------|--------------------------------------------|--------------------------------------------------------|-----------------|---------------|
50+
| Agents | `Agents` | Count | Average, Maximum, Minimum, Total (Sum) | `EventType` | PT1M | No |
51+
| IndexedFiles | `IndexedFiles` | Count | Average, Maximum, Minimum, Total (Sum) | `ErrorCode`, `Status`, `VectorStoreId` | PT1M | No |
52+
| Messages | `Messages` | Count | Average, Maximum, Minimum, Total (Sum) | `EventType`, `ThreadId` | PT1M | No |
53+
| Runs | `Runs` | Count | Average, Maximum, Minimum, Total (Sum) | `AgentId`, `RunStatus`, `StatusCode`, `StreamType` | PT1M | No |
54+
| Threads | `Threads` | Count | Average, Maximum, Minimum, Total (Sum) | `EventType` | PT1M | No |
55+
| Tokens | `Tokens` | Count | Average, Maximum, Minimum, Total (Sum) | `AgentId`, `TokenType` | PT1M | No |
56+
| ToolCalls | `ToolCalls` | Count | Average, Maximum, Minimum, Total (Sum) | `AgentId`, `ToolName` | PT1M | No |
57+
58+
59+
60+
## Analyze monitoring data
61+
62+
There are many tools for analyzing monitoring data.
63+
64+
### Azure Monitor tools
65+
66+
Azure Monitor supports the [metrics explorer](/azure/azure-monitor/essentials/metrics-getting-started), a tool in the Azure portal that allows you to view and analyze metrics for Azure resources. For more information, see Analyze metrics with Azure Monitor metrics explorer.
67+
68+
## Azure Monitor export tools
69+
70+
You can get data out of Azure Monitor into other tools by using the [REST API for metrics](/rest/api/monitor/operation-groups) to extract metric data from the Azure Monitor metrics database. The API supports filter expressions to refine the data retrieved. For more information, see [Azure Monitor REST API reference](/rest/api/monitor/filter-syntax).
71+
72+
To get started with the REST API for Azure Monitor, see [Azure monitoring REST API walkthrough](/azure/azure-monitor/essentials/rest-api-walkthrough).
73+
74+
## Alerts
75+
76+
Azure Monitor alerts proactively notify you when specific conditions are found in your monitoring data. Alerts allow you to identify and address issues in your system before your customers notice them. For more information, see Azure Monitor alerts.
77+
78+
There are many sources of common alerts for Azure resources. [The Azure Monitor Baseline Alerts (AMBA)](https://aka.ms/amba) site provides a semi-automated method of implementing important platform metric alerts, dashboards, and guidelines. The site applies to a continually expanding subset of Azure services, including all services that are part of the Azure Landing Zone (ALZ).
79+
80+
The common alert schema standardizes the consumption of Azure Monitor alert notifications. For more information, see [Common alert schema](/azure/azure-monitor/alerts/alerts-common-schema).
81+
82+
[Metric alerts](/azure/azure-monitor/alerts/alerts-types#metric-alerts) evaluate resource metrics at regular intervals. Metric alerts can also apply multiple conditions and dynamic thresholds.
83+
84+
Every organization's alerting needs vary and can change over time. Generally, all alerts should be actionable and have a specific intended response if the alert occurs. If an alert doesn't require an immediate response, the condition can be captured in a report rather than an alert. Some use cases might require alerting anytime certain error conditions exist. In other cases, you might need alerts for errors that exceed a certain threshold for a designated time period.
85+
86+
Depending on what type of application you're developing with your use of Azure AI Foundry Agent Service, [Azure Monitor Application Insights](/azure/azure-monitor/overview) might offer more monitoring benefits at the application layer.
87+
88+
### Azure AI Foundry Agent Service alert rules
89+
90+
You can set alerts for any metric listed in the [monitoring data reference](../reference/monitor-service.md).
91+
92+
[!INCLUDE [horz-monitor-advisor-recommendations](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-advisor-recommendations.md)]
93+
94+
## Related content
95+
96+
- See [Monitoring data reference](../reference/monitor-service.md) for a reference of the metrics and other important values created for Azure AI Foundry Agent Service.
97+
- See [Monitoring Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource) for general details on monitoring Azure resources.

articles/ai-foundry/agents/how-to/tools/azure-functions.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ To use all features of function calling including parallel functions, you need t
2727
## Prerequisites
2828

2929
* [Azure Functions Core Tools v4.x](/azure/azure-functions/functions-run-local)
30-
* [A deployed agent with the standard setup](/../../environment-setup.md#choose-your-setup)
30+
* [A deployed agent with the standard setup](../../environment-setup.md#choose-your-setup)
3131
> [!NOTE]
3232
> The basic agent setup is not supported.
3333
* [Azurite](https://github.com/Azure/Azurite)

articles/ai-foundry/agents/how-to/triggers.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -60,13 +60,13 @@ Start by adding the Azure AI Foundry Agent service connectors to your workflow.
6060

6161
1. Depending on your use-case, choose the actions you need.
6262

63-
If you want to create a new [thread](./concepts/threads-runs-messages/md#threads) for each new event of your trigger, add the following in sequence:
63+
If you want to create a new [thread](../concepts/threads-runs-messages/md#threads) for each new event of your trigger, add the following in sequence:
6464
1. Create thread
6565
1. Create run
6666
1. Get run
6767
1. List messages
6868

69-
If you want to create a new [run](./concepts/threads-runs-messages.md#runs) in the same thread for each new event, add the following in sequence:
69+
If you want to create a new [run](../concepts/threads-runs-messages.md#runs) in the same thread for each new event, add the following in sequence:
7070

7171
1. Create run
7272
1. Get run
@@ -91,7 +91,7 @@ The **List Agent** connector only lists all the agents you have in your AI proje
9191

9292
## Configure the "create thread" connector
9393

94-
The **create thread** connector creates a new [thread](./concepts/threads-runs-messages.md#threads), which is a conversation session between an Agent and a user. Threads store [messages](./concepts/threads-runs-messages.md#messages) and automatically handle truncation to fit content into a model's context. You can configure the **create thread** connector with the following:
94+
The **create thread** connector creates a new [thread](../concepts/threads-runs-messages.md#threads), which is a conversation session between an Agent and a user. Threads store [messages](../concepts/threads-runs-messages.md#messages) and automatically handle truncation to fit content into a model's context. You can configure the **create thread** connector with the following:
9595

9696
**messages (optional)**: You can add the message you want the AI agent to respond to. Add the role as **user** for the message you want the agent to respond to. It can be the event payload from the trigger, for example a form response field. It can also be a constant message, for example always triggering with the phrase "*what is the latest AI news this week?*"
9797

@@ -120,7 +120,7 @@ The **create thread** connector creates a new [thread](./concepts/threads-runs-m
120120

121121
## Configure the "create run" connector
122122

123-
The **create run** connector creates a new [run](./concepts/threads-runs-messages.md#runs), which is an activation of an Agent to begin running based on the contents of the thread. The agent uses its configuration (such as tool resources) and the thread's messages to perform tasks by calling models and tools. As part of a run, the agent appends messages to the thread.
123+
The **create run** connector creates a new [run](../concepts/threads-runs-messages.md#runs), which is an activation of an Agent to begin running based on the contents of the thread. The agent uses its configuration (such as tool resources) and the thread's messages to perform tasks by calling models and tools. As part of a run, the agent appends messages to the thread.
124124

125125
To configure the **create run** connector, click on it and provide the following information:
126126

articles/ai-foundry/agents/overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,7 @@ Azure AI Foundry Agent Service provides a production-ready foundation for deploy
103103
| **2. Multi-agent coordination** | Built-in support for agent-to-agent messaging. |
104104
| **3. Tool orchestration** | Server-side execution and retry of [tool calls](how-to\tools\overview.md) with structured logging. No manual orchestration required. |
105105
| **4. Trust and safety** | Integrated [content filters](/azure/ai-services/agents/ai-services/openai/how-to/content-filters) help prevent misuse and mitigate prompt injection risks (XPIA). all outputs are policy-governed. |
106-
| **5. Enterprise integration** | Bring your own [storage](/azure/ai-services/agents/ai-services/agents/how-to/use-your-own-resourcesuse-an-existing-azure-cosmos-db-for-nosql-account-for-thread-storage), [Azure AI Search index](/azure/ai-services/agents/ai-services/agents/how-to/use-your-own-resourcesuse-an-existing-azure-ai-search-resource), and [virtual network](how-to\virtual-networks.md) to meet compliance needs. |
106+
| **5. Enterprise integration** | Bring your own [storage](./how-to/use-your-own-resources.md#use-an-existing-azure-cosmos-db-for-nosql-account-for-thread-storage), [Azure AI Search index](./how-to/use-your-own-resources.md#use-an-existing-azure-ai-search-resource), and [virtual network](how-to\virtual-networks.md) to meet compliance needs. |
107107
| **6. Observability and debugging** | Threads, tool invocations, and message traces are [fully traceable](concepts\tracing.md); [Application Insights integration](./how-to/metrics.md) for telemetry |
108108
| **7. Identity and policy control** | Built on Microsoft Entra with full support for RBAC, audit logs, and enterprise conditional access. |
109109

articles/ai-foundry/agents/quotas-limits.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ The 2,000,000 agent limit refers to the maximum number of distinct Agent resourc
3030

3131
## Quotas and limits for Azure OpenAI models
3232

33-
See the [Azure OpenAI](/azure/ai-services/agents/ai-services/openai/quotas-limits) for current quotas and limits for the Azure OpenAI models that you can use with Azure AI Foundry Agent Service.
33+
See the [Azure OpenAI](../../ai-services/openai/quotas-limits.md) for current quotas and limits for the Azure OpenAI models that you can use with Azure AI Foundry Agent Service.
3434

3535
## Next steps
3636

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
title: Monitoring data reference for Azure AI Foundry Agent Service
3+
description: This article contains important reference material you need when you monitor Azure AI Foundry Agent Service by using Azure Monitor.
4+
ms.date: 05/05/2025
5+
ms.custom: horz-monitor, subject-monitoring
6+
ms.topic: reference
7+
author: aahill
8+
ms.author: aahi
9+
ms.service: azure-ai-agent-service
10+
---
11+
12+
# Azure AI Foundry Agent Service monitoring data reference
13+
14+
[!INCLUDE [horz-monitor-ref-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-intro.md)]
15+
16+
See [Monitor Azure AI Foundry Agent Service](../how-to/metrics.md) for details on the data you can collect on your agents.
17+
18+
## Metrics
19+
20+
Here are the most important metrics we think you should monitor for Azure AI Foundry Agent Service. Later in this article is a longer list of all available metrics which contains more details on metrics in this shorter list. _See the below list for most up to date information. We're working on refreshing the tables in the following sections._
21+
22+
- [Category: Agents](#category-agents)
23+
<!-- - Indexed files -->
24+
25+
## Supported metrics
26+
27+
This section lists all the automatically collected platform metrics for this service. These metrics are also part of the global list of [all platform metrics supported in Azure Monitor](/azure/azure-monitor/reference/supported-metrics/metrics-index#supported-metrics-per-resource-type).
28+
29+
[!INCLUDE [horz-monitor-ref-metrics-tableheader](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-tableheader.md)]
30+
[!INCLUDE [Microsoft.MachineLearningServices/workspaces](~/reusable-content/ce-skilling/azure/includes/azure-monitor/reference/metrics/microsoft-machinelearningservices-workspaces-metrics-include.md)]
31+
32+
33+
## Related content
34+
35+
- See [Monitor Azure AI Foundry Agent Service](../how-to/metrics.md) for a description of monitoring Azure AI Foundry Agent Service.
36+
- See [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource) for details on monitoring Azure resources.

articles/ai-foundry/agents/whats-new.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ You can now use the Azure AI Foundry Agent Service in the [Azure AI Foundry](htt
7878

7979
### Azure AI Service public preview
8080

81-
Azure AI Service is now available in preview. The service builds off of the [Assistants API](/azure/ai-services/agents/ai-services/openai/how-to/assistant) in Azure OpenAI, and offers several additional features, such as:
81+
Azure AI Service is now available in preview. The service builds off of the Assistants API in Azure OpenAI, and offers several additional features, such as:
8282

8383
* Several [additional tools](how-to\tools\overview.md) to enhance your AI agents' functionality, such as the ability to use Bing and as a knowledge source and call functions.
8484
* The ability to use non Azure OpenAI [models](concepts\model-region-support.md):

0 commit comments

Comments
 (0)