You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-foundry/how-to/deploy-models-managed-pay-go.md
+16-13Lines changed: 16 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: PayGo Surcharge for protected models in Azure AI Foundry
2
+
title: Deploy Azure AI Foundry Models with pay-as-you-go billing to managed compute
3
3
titleSuffix: Azure AI Foundry
4
-
description: Learn how to deploy third-party protected models on Azure AI Foundry managed compute and understand how pay-as-you-go surcharge billing works.
4
+
description: Learn how to deploy protected models from partners and community on Azure AI Foundry managed compute and understand how pay-as-you-go surcharge billing works.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-foundry
7
7
ms.custom:
@@ -13,22 +13,25 @@ ms.author: mopeakande
13
13
author: msakande
14
14
---
15
15
16
-
**PayGo Surcharge for Models on Managed Compute**
16
+
# Deploy Azure AI Foundry Models with pay-as-you-go billing to managed compute
17
17
18
-
Azure AI Foundry offers a comprehensive catalog of models, including models from third-party partner and the community. These third-party partner and community models offered for deployment on Managed Compute are either open or protected models. The deployment of protected models on Managed Compute involves pay as you go billing for the customer in two dimensions: per hour Azure Machine Learning Compute billing for the virtual machines employed in the deployment of the protected model and surcharge billing for the model as set by the model publisher on the Azure marketplace offer. This pay as you go billing of model surcharge and azure compute is pro-rated per minute based on the uptime of these managed online deployments.
In this article, you will learn how to use third party protected models offered via Azure Marketplace for deployment on Managed Compute within Azure AI Foundry Catalog. Azure AI Foundry enables a seamless subscription and transactability experience for these protected models as you create and consume your dedicated model deployments at scale.
20
+
Azure AI Foundry Models include a comprehensive catalog of models organized into two categories—Models sold directly by Azure, and Models from partners and community. These models from partners and community, which are available for deployment on a managed compute, are either open or protected models. The deployment of protected models on managed compute (preview) involves pay-as-you-go billing for the customer in two dimensions: per-hour Azure Machine Learning compute billing for the virtual machines employed in the deployment, and surcharge billing for the model as set by the model publisher on the Azure Marketplace offer. This pay-as-you-go billing of Azure compute and model surcharge is pro-rated per minute based on the uptime of these managed online deployments.
21
21
22
-
**Prerequisites**
22
+
In this article, you learn how to use protected models from partners and community, offered via Azure Marketplace for deployment on managed compute. Azure AI Foundry enables a seamless subscription and transaction experience for these protected models as you create and consume your dedicated model deployments at scale.
23
+
24
+
## Prerequisites
23
25
24
26
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
25
27
26
-
- If you don't have one,[create a hub based project](/azure/ai-foundry/how-to/create-projects?pivots=hub-project).
28
+
- If you don't have one,[create a [!INCLUDE [hub](../includes/hub-project-name.md)]](create-projects.md?pivots=hub-project).
27
29
28
-
- Marketplace purchases enabled for your Azure subscription. Learn more [here](/azure/cost-management-billing/manage/enable-marketplace-purchases).
30
+
-[Azure Marketplace purchases enabled](/azure/cost-management-billing/manage/enable-marketplace-purchases) for your Azure subscription.
29
31
30
32
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Foundry portal. To perform the steps in this article, your user account must be assigned a *custom role* with the following permissions. User accounts assigned the *Owner* or *Contributor* role for the Azure subscription can also create deployments. For more information on permissions, see [Role-based access control in Azure AI Foundry portal](/azure/ai-foundry/concepts/rbac-azure-ai-foundry).
31
33
34
+
32
35
- On the Azure subscription—**to subscribe the workspace/project to the Azure Marketplace offering**:
1. Sign in to [Azure AI Foundry](https://ai.azure.com/?cid=learnDocs) and go to the Home page.
53
56
@@ -63,21 +66,21 @@ In this article, you will learn how to use third party protected models offered
63
66
64
67
1. You can then customize your deployment configuration for parameters such as the instance count and select an existing endpoint for the deployment or create a new one. For this example, we consider an instance count of **1** and create a new endpoint for the deployment.
65
68
66
-
:::image type="content" source="media/deploy-models-managed-pay-go/image1.png" alt-text="Screenshot of the deployment configuration screen for a protected model in Azure AI Foundry.":::
69
+
:::image type="content" source="media/deploy-models-managed-pay-go/deployment-configuration.png" alt-text="Screenshot of the deployment configuration screen for a protected model in Azure AI Foundry." lightbox="media/deploy-models-managed-pay-go/deployment-configuration.png":::
67
70
68
71
1. Click **Next** to proceed to the pricing breakdown page.
69
72
70
73
1. Review the pricing breakdown for the deployment, terms of use and license agreement associated with the model's offer on Marketplace. The pricing breakdown helps inform what the aggregated pricing for the model deployed would be, where the surcharge for the model is a function of the number of GPUs in the VM instance that is selected in the previous steps. In addition to the applicable surcharge for the model, Azure Compute charges also apply based on your deployment configuration. If you have existing reservations or azure savings plan, the invoice for the compute charges will honor and reflect the discounted VM pricing.
71
74
72
-
:::image type="content" source="media/deploy-models-managed-pay-go/image2.png" alt-text="Screenshot of the pricing breakdown page for a protected model deployment in Azure AI Foundry.":::
75
+
:::image type="content" source="media/deploy-models-managed-pay-go/pricing-breakdown.png" alt-text="Screenshot of the pricing breakdown page for a protected model deployment in Azure AI Foundry." lightbox="media/deploy-models-managed-pay-go/pricing-breakdown.png":::
73
76
74
77
1. Select the checkbox to acknowledge understanding of pricing and terms of use, and then, click **Deploy**. It takes about 15-20 mins for the deployment to complete.
75
78
76
-
**Network Isolation of deployments**
79
+
## Network Isolation of deployments
77
80
78
81
Collections in the model catalog can be deployed within your isolated networks using workspace managed virtual network. For more information on how to configure your workspace managed networks, see [here.](/azure/machine-learning/how-to-managed-network#configure-a-managed-virtual-network-to-allow-internet-outbound)
79
82
80
-
Limitation
83
+
#### Limitation
81
84
82
85
An Azure AI Foundry project with ingress Public Network Access disabled can only support a single active deployment of one of the protected models from the catalog. Attempts to create more active deployments result in deployment creation failures.
0 commit comments