Skip to content

Commit f1cc89f

Browse files
Merge pull request #7365 from MicrosoftDocs/main
Auto Publish – main to live - 2025-09-30 05:09 UTC
2 parents 9fffe4d + 5ca3513 commit f1cc89f

35 files changed

+714
-480
lines changed

articles/ai-foundry/.openpublishing.redirection.ai-studio.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -913,6 +913,11 @@
913913
"redirect_url": "/azure/ai-studio/how-to/data-add",
914914
"redirect_document_id": false
915915
},
916+
{
917+
"source_path_from_root": "/articles/ai-foundry/openai/how-to/manage-costs.md",
918+
"redirect_url": "/azure/ai-foundry/foundry-models/how-to/manage-costs",
919+
"redirect_document_id": true
920+
},
916921
{
917922
"source_path_from_root": "/articles/ai-studio/how-to/simulator-interaction-data.md",
918923
"redirect_url": "/azure/ai-studio/how-to/data-add",
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
title: Consolidated View for AI Services in the Azure Portal
3+
description: Discover how the AI Foundry consolidated view in the Azure portal simplifies AI workload management with cost, usage, and quota insights in one place.
4+
#customer intent: As an Azure user managing AI workloads, I want to monitor costs and resource usage in a single view so that I can optimize spending and performance.
5+
author: jonburchel
6+
ms.author: jburchel
7+
ms.reviewer: aashishb
8+
ms.date: 09/29/2025
9+
ms.topic: concept-article
10+
ms.service: azure-ai-foundry
11+
---
12+
13+
# Consolidated view for AI services in the Azure portal
14+
15+
The [AI Foundry consolidated view](https://portal.azure.com/#view/Microsoft_Azure_ProjectOxford/CognitiveServicesHub/~/overview) shows key insights about your AI workloads in the Azure portal. Instead of switching between tools, you see in one place how your AI resources perform, what they cost, and whether you’re nearing usage limits.
16+
17+
## Why use the consolidated view?
18+
19+
- **Faster visibility**: Check cost, quota, and resource usage at a glance.
20+
- **Built-in governance**: Spot early warning signs like quota thresholds and cost spikes before they become blockers.
21+
- **Lightweight experience**: No new resource types or complex setup required. It surfaces what you already use.
22+
23+
## Key features
24+
25+
- **Alerts and service health**
26+
27+
View key alerts for your AI resources so you can investigate and fix issues without leaving the dashboard.
28+
29+
- **Accumulated costs**
30+
31+
View your costs over time by subscription or resource type. Identify trends, track experiments, and drill into **Cost management** for deeper analysis.
32+
33+
- **Active resources by cost**
34+
35+
You can see which active resources are driving the most spend to help you optimize usage and clean up idle resources quickly.
36+
37+
- **Model utilization**
38+
39+
Track AI model usage over time. Spot peaks, dips, and usage patterns across your projects to make better scaling decisions.
40+
41+
- **Resource breakdown by type**
42+
43+
Understand which AI services you use most (for example, Azure OpenAI, Speech, Language). This helps with cost allocation and planning for future workloads.
44+
45+
- **Quota utilization**
46+
47+
Monitor quota usage by model and region. Stay ahead of capacity issues with quick links to **Quota management** for requesting increases.
48+
49+
## Visual layout of the consolidated view
50+
51+
The dashboard shows tiles for each visibility area:
52+
53+
- **Top row**: Alerts, active resources by cost, and accumulated costs
54+
- **Middle row**: Model utilization over time
55+
- **Bottom row**: Resource breakdown by type and quota utilization
56+
57+
:::image type="content" source="../media/ai-foundry-consolidated-view/consolidated-view-dashboard.png" alt-text="Screenshot of a dashboard with tiles for alerts, resource costs, model utilization, resource breakdown, and quota utilization." lightbox="../media/ai-foundry-consolidated-view/consolidated-view-dashboard.png":::
58+
59+
## What you can do next
60+
61+
- Open **Cost analysis** from the dashboard to analyze costs.
62+
- Request quota increases in **Quota management** when you reach limits.
63+
- Use utilization insights to decide where to scale, pause, or reallocate resources.
64+
- Keep AI projects running smoothly by acting on alerts.
65+
66+
## Related content
67+
68+
- [Azure AI Foundry management center](management-center.md)
69+
- [Azure AI Foundry status dashboard](../azure-ai-foundry-status-dashboard-documentation.md)
Lines changed: 165 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,165 @@
1+
---
2+
title: Plan and manage Costs
3+
description: Manage Azure AI Foundry costs by estimating expenses, monitoring usage, and setting up alerts for spending anomalies with Microsoft Cost Management.
4+
#customer intent: As an IT admin, I want to estimate and manage costs for Azure AI Foundry so that I can optimize my organization's budget.
5+
author: jonburchel
6+
ms.author: jburchel
7+
ms.reviewer: aashishb
8+
ms.date: 09/26/2025
9+
ms.topic: concept-article
10+
ms.service: azure-ai-foundry
11+
---
12+
13+
# Plan and manage costs for Azure AI Foundry
14+
15+
This article describes how to plan for and manage costs for [Azure AI Foundry](https://ai.azure.com/?cid=learnDocs). First, use the Azure pricing calculator to help plan for Azure AI Foundry costs before you add any resources. Next, as you add Azure resources, review the estimated costs.
16+
17+
> [!TIP]
18+
> Azure AI Foundry doesn't have a specific page in the Azure pricing calculator. Azure AI Foundry is composed of several other Azure services, some of which are optional. This article provides information on using the pricing calculator to estimate costs for these services.
19+
20+
You use Azure AI services in Azure AI Foundry portal. Costs for Azure AI services are only a portion of the monthly costs in your Azure bill. You're billed for all Azure services and resources used in your Azure subscription, including third-party services.
21+
22+
## Prerequisites
23+
24+
Cost analysis in Microsoft Cost Management supports most Azure account types, but not all of them. To view the full list of supported account types, see [Understand Cost Management data](/azure/cost-management-billing/costs/understand-cost-mgt-data). To view cost data, at a minimum, you need read access for an Azure account. For information about assigning access to Microsoft Cost Management data, see [Assign access to data](/azure/cost-management-billing/costs/assign-access-acm-data).
25+
26+
## Estimate costs before using Azure AI services
27+
28+
Use the [Azure pricing calculator](https://azure.microsoft.com/pricing/calculator/) to estimate costs before you add Azure AI services.
29+
30+
1. Select a product such as Azure OpenAI in the Azure pricing calculator.
31+
32+
:::image type="content" source="../media/manage-costs/azure-openai-pricing-calculator.png" alt-text="Screenshot of selecting Azure OpenAI in the Azure pricing calculator.":::
33+
34+
1. Enter the number of units you plan to use. For example, enter the number of input tokens.
35+
36+
:::image type="content" source="../media/manage-costs/azure-openai-cost-estimate.png" alt-text="Screenshot of Azure OpenAI cost estimate in the Azure pricing calculator." lightbox="../media/manage-costs/azure-openai-cost-estimate.png":::
37+
38+
1. Select more than one product to estimate costs for multiple products. For example, search for and select Azure AI Search to add potential costs.
39+
40+
:::image type="content" source="../media/manage-costs/azure-ai-foundry-cost-calculator.png" alt-text="Screenshot showing the cost calculator in Azure." lightbox="../media/manage-costs/azure-ai-foundry-cost-calculator.png":::
41+
42+
As you add new resources to your project, return to this calculator and add the same resource here to update your cost estimates.
43+
44+
## Costs associated with Azure AI Foundry
45+
46+
When you create an Azure AI Foundry resource, you pay to use services such as Azure OpenAI, Speech, Content Safety, Vision, Document Intelligence, and Language. Costs vary for each service and for some features within each service. You can find more details on the [Azure AI services](https://azure.microsoft.com/pricing/details/cognitive-services/) pricing page.
47+
48+
## Monitor costs
49+
50+
As you use Azure AI Foundry, you incur costs. Azure resource usage unit costs vary by time intervals (seconds, minutes, hours, and days) or by unit usage (bytes, megabytes, and so on). You can see the incurred costs in [cost analysis](/azure/cost-management-billing/costs/quick-acm-cost-analysis).
51+
52+
When you use cost analysis, you view costs in graphs and tables for different time intervals. Some examples are by day, current and prior month, and year. You also view costs against budgets and forecasted costs. Switching to longer views over time can help you identify spending trends so you can see where overspending might occur. If you create budgets, you can also easily see where they're exceeded.
53+
54+
### Monitor Azure AI Foundry costs
55+
56+
You can access cost analysis from the [Azure portal](https://portal.azure.com/).
57+
58+
> [!IMPORTANT]
59+
> Your Azure AI Foundry costs are only a subset of your overall application or solution costs. You need to monitor costs for all Azure resources used in your application or solution.
60+
61+
Here's an example of how to monitor costs for a project. The costs are used as an example only. Your costs vary depending on the services that you use and the amount of usage.
62+
63+
1. Sign in to [Azure AI Foundry](https://ai.azure.com/?cid=learnDocs).
64+
1. Select your project, then select **Management center** from the left menu.
65+
1. Under the **Resource** heading, select **Overview**.
66+
1. Under the **Resource properties**, select on the resource group link. The [Azure portal](https://portal.azure.com/) opens to the resource group for your Foundry resource.
67+
68+
:::image type="content" source="../media/manage-costs/azure-cost-analysis-overview.png" alt-text="Screenshot showing the AI Foundry portal with the resource Overview section and resource group highlighted." lightbox="../media/manage-costs/azure-cost-analysis-overview.png":::
69+
70+
1. Select **Cost analysis**.
71+
72+
:::image type="content" source="../media/manage-costs/azure-cost-overview-filters.png" alt-text="Screenshot of the Azure portal showing the Cost Analysis section under Cost Management.":::
73+
74+
1. You see the cost overview. You can also add filters like the deployment level tags to see the costs based on model deployment, as shown in the following screenshot.
75+
76+
:::image type="content" source="../media/manage-costs/cost-overview-deployment-tags.png" alt-text="Screenshot of cost overview with deployment level tags." lightbox="../media/manage-costs/cost-overview-deployment-tags.png":::
77+
78+
1. Select **Costs by resource** > **Resources** to open the Cost analysis page.
79+
80+
:::image type="content" source="../media/manage-costs/azure-cost-analysis-resources.png" alt-text="Screenshot of the Azure portal cost analysis with the button to select costs by resources.":::
81+
82+
1. You can see cost of your Foundry resource and the split of that cost across multiple model deployments under that resource,
83+
84+
:::image type="content" source="../media/manage-costs/azure-foundry-cost-split.png" alt-text="Screenshot of split of Foundry resource cost across model deployments." lightbox="../media/manage-costs/azure-foundry-cost-split.png":::
85+
86+
### Monitor costs for models in Azure Marketplace
87+
88+
Azure Marketplace offers serverless API deployments. Model publishers might apply different costs depending on the offering. Each project in the Azure AI Foundry portal has its own subscription with the offering, which you can use to monitor the costs and consumption happening on that project. Use [Microsoft Cost Management](https://azure.microsoft.com/products/cost-management) to monitor the costs:
89+
90+
1. Sign in to [Azure portal](https://portal.azure.com/).
91+
92+
1. Select the portal menu icon to open the left pane.
93+
94+
:::image type="content" source="../media/manage-costs/azure-portal-menu-icon.png" alt-text="Screenshot of the portal menu icon.":::
95+
96+
1. On the left pane, select **Cost Management + Billing** and then select **Cost Management**.
97+
98+
1. On the left pane, under the section for **Reporting + analytics**, select **Cost Analysis**.
99+
100+
1. Select a view such as **Resources**. The cost associated with each resource is displayed.
101+
102+
:::image type="content" source="../media/manage-costs/cost-analysis-resource-filter.png" alt-text="Screenshot of the Cost Analysis tool displaying how to show cost per resource." lightbox="../media/manage-costs/cost-analysis-resource-filter.png":::
103+
104+
1. On the **Type** column, select the filter icon to filter all the resources of type **microsoft.saas/resources**. This type corresponds to resources created from offers available in Azure Marketplace. For convenience, you can filter by resource types containing the string **SaaS**.
105+
106+
:::image type="content" source="../media/manage-costs/filter-resource-type-saas.png" alt-text="Screenshot of how to filter by resource type containing the string SaaS." lightbox="../media/manage-costs/filter-resource-type-saas.png":::
107+
108+
1. One resource is displayed for each model offer per project. Naming of those resources is [Model offer name]-[GUID].
109+
110+
1. Select to expand the resource details to get access to each of the costs meters associated with the resource.
111+
112+
- **Tier** represents the offering.
113+
- **Product** is the specific product inside the offering.
114+
115+
Some model providers might use the same name for both.
116+
117+
:::image type="content" source="../media/manage-costs/resource-details-cost-meters.png" alt-text="A screenshot showing different resources corresponding to different model offers and their associated meters." lightbox="../media/manage-costs/resource-details-cost-meters.png":::
118+
119+
> [!TIP]
120+
> Remember that one resource is created per project, for each plan that your project subscribes to.
121+
122+
1. When you expand the details, costs are reported per each of the meters associated with the offering. Each meter might track different sources of costs like inferencing, or fine tuning. The following meters are displayed (when some cost is associated with them):
123+
124+
| **Meter** | **Group** | **Description** |
125+
| ---- | ---- | ---- |
126+
| paygo-inference-input-tokens | Base model | Costs associated with the tokens used as input for inference of a base model. |
127+
| paygo-inference-output-tokens | Base model | Costs associated with the tokens generated as output for the inference of base model. |
128+
| paygo-finetuned-model-inference-hosting | Fine-tuned model | Costs associated with the hosting of an inference endpoint for a fine-tuned model. This value isn't the cost of hosting the model, but the cost of having an endpoint serving it. |
129+
| paygo-finetuned-model-inference-input-tokens | Fine-tuned model | Costs associated with the tokens used as input for inference of a fine tuned model. |
130+
| paygo-finetuned-model-inference-output-tokens | Fine-tuned model | Costs associated with the tokens generated as output for the inference of a fine tuned model. |
131+
132+
## Create budgets
133+
134+
To manage costs, create [budgets](/azure/cost-management-billing/costs/tutorial-acm-create-budgets) and set up [alerts](/azure/cost-management-billing/costs/cost-mgt-alerts-monitor-usage-spending) that automatically notify stakeholders of spending anomalies and overspending risks. Alerts are based on spending compared to budget and cost thresholds. Create budgets and alerts for Azure subscriptions and resource groups, so they're useful as part of an overall cost monitoring strategy.
135+
136+
Create budgets with filters for specific resources or services in Azure if you want more granularity in your monitoring. Filters help ensure that you don't accidentally create new resources that cost you more money. For more about the filter options when you create a budget, see [Group and filter options](/azure/cost-management-billing/costs/group-filter).
137+
138+
## Export cost data
139+
140+
You can also [export your cost data](/azure/cost-management-billing/costs/tutorial-export-acm-data) to a storage account. Exporting data is helpful when you or others need to do more data analysis for costs. For example, finance teams can analyze the data using Excel or Power BI. You can export your costs on a daily, weekly, or monthly schedule and set a custom date range. Exporting cost data is the recommended way to retrieve cost datasets.
141+
142+
## Understand the full billing model for Azure AI services
143+
144+
Azure AI services run on Azure infrastructure that accrues costs along
145+
with Azure AI when you deploy the new resource. It's important to
146+
understand that extra infrastructure might accrue cost. You need to
147+
manage that cost when you make changes to deployed resources.
148+
149+
When you create or use Azure AI services resources, you might get charged based on the services that you use. Two billing models are available for Azure AI services:
150+
151+
- Serverless API: With serverless API pricing, you're billed according to the Azure AI services offering that you use, based on its billing information.
152+
153+
- Commitment tiers: With commitment tier pricing, you commit to using several service features for a fixed fee, enabling you to have a predictable total cost based on the needs of your workload. You're billed according to the plan you choose. For information on available services, how to sign up, and considerations when purchasing a plan, see [Quickstart: purchase commitment tier pricing](/azure/ai-services/commitment-tier).
154+
155+
> [!NOTE]
156+
> If you use the resource above the quota provided by the commitment plan, you pay for the extra usage as described in the overage amount in the Azure portal when you purchase a commitment plan.
157+
158+
You can pay for Azure AI services charges with your Azure Prepayment (previously called monetary commitment) credit. However, you can't use Azure Prepayment credit to pay for charges for third-party products and services, including ones from Azure Marketplace.
159+
160+
For more information, see the [Azure pricing calculator](https://azure.microsoft.com/pricing/calculator/).
161+
162+
## Related content
163+
164+
- [Azure AI Foundry management center](management-center.md)
165+
- [Azure AI Foundry status dashboard](../azure-ai-foundry-status-dashboard-documentation.md)

0 commit comments

Comments
 (0)