Skip to content

Commit dcca6a9

Browse files
committed
ptu updates:
1 parent 418e65a commit dcca6a9

File tree

5 files changed

+31
-14
lines changed

5 files changed

+31
-14
lines changed

articles/ai-services/openai/how-to/provisioned-get-started.md

Lines changed: 17 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,16 @@ After you purchase a commitment on your quota, you can create a deployment. To c
7575

7676
Important things to note:
7777
* The deployment dialog contains a reminder that you can purchase an Azure Reservation for Azure OpenAI Provisioned to obtain a significant discount for a term commitment.
78-
* There is a message that tells you the list, hourly price of the deployment that you would be charged if this deployment is not covered by a reservation. This is a list price that does not include any negotiated discounts for your company.
78+
79+
Once you have entered the deployment settings, click **Confirm Pricing** to continue. A pricing confirmation dialog will appear that will display the list price for the deployment, if you choose to pay for it on an hourly basis, with no Azure Reservation to provide a term discount.
80+
81+
If you are unsure of the costs, cancel the deployment and proceed once you understand the payment model and underlying costs for provisioned deployment. This step may prevent unexpected, high charges on your payment invoice. Resources to educate yourself include:
82+
83+
* [Azure Pricing Portal](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/)
84+
* [Understanding the provisioned throughput purchase model](provisioned-throughput-onboarding.md#understanding-the-provisioned-throughput-purchase-model)
85+
86+
87+
:::image type="content" source="../media/provisioned/confirm-pricing.png" alt-text="Screenshot of the Azure OpenAI Studio deployment page for a provisioned deployment." lightbox="../media/provisioned/confirm-pricing.png":::
7988

8089
If you wish to create your deployment programmatically, you can do so with the following Azure CLI command. Update the `sku-capacity` with the desired number of provisioned throughput units.
8190

@@ -110,16 +119,17 @@ Things to notice:
110119

111120
Selecting a resource and clicking **Switch resource** will cause the deployment dialog to redisplay using the selected resource. You can then proceed to create your deployment in the new region.
112121

113-
Learn more about the purchase model and how to purchase a reservation:
114-
115-
* [Azure OpenAI provisioned onboarding guide](./provisioned-throughput-onboarding.md)
116-
* [Guide for Azure OpenAI provisioned reservations](../concepts/provisioned-throughput.md)
117-
118122
## Optionally purchase a reservation
119123

120124
Following the creation of your deployment, you might want to purchase a term discount via an Azure Reservation. An Azure Reservation can provide a substantial discount on the hourly rate for users intending to use the deployment beyond a few days.
121125

122-
For more information on purchasing a reservation, see [Save costs with Microsoft Azure OpenAI service Provisioned Reservations](/azure/cost-management-billing/reservations/azure-openai).
126+
For more information on the purchase model and reservations, see:
127+
* [Save costs with Microsoft Azure OpenAI service provisioned reservations](/azure/cost-management-billing/reservations/azure-openai).
128+
* [Azure OpenAI provisioned onboarding guide](./provisioned-throughput-onboarding.md)
129+
* [Guide for Azure OpenAI provisioned reservations](../concepts/provisioned-throughput.md)
130+
131+
> [!IMPORTANT]
132+
> Capacity availability for model deployments is dynamic and changes frequently across regions and models. To prevent you from purchasing a reservation for more PTUs than you can use, create deployments first, and then purchase the Azure Reservation to cover the PTUs you have deployed. This best practice will ensure that you can take full advantage of the reservation discount and prevent you from purchasing a term commitment that you cannot use.
123133
124134
## Make your first inferencing calls
125135
The inferencing code for provisioned deployments is the same a standard deployment type. The following code snippet shows a chat completions call to a GPT-4 model. For your first time using these models programmatically, we recommend starting with our [quickstart guide](../quickstart.md). Our recommendation is to use the OpenAI library with version 1.0 or greater since this includes retry logic within the library.

articles/ai-services/openai/how-to/provisioned-throughput-onboarding.md

Lines changed: 10 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: Azure OpenAI Service Provisioned Throughput Units (PTU) onboarding
33
description: Learn about provisioned throughput units onboarding and Azure OpenAI.
44
ms.service: azure-ai-openai
55
ms.topic: conceptual
6-
ms.date: 08/07/2024
6+
ms.date: 09/12/2024
77
manager: nitinme
88
author: mrbullwinkle
99
ms.author: mbullwin
@@ -82,6 +82,9 @@ Customers that require long-term usage of provisioned deployments, however, migh
8282
> * The cost savings achieved by purchasing an Azure Reservation for Azure OpenAI Provisioned are significant, and it will be less expensive in many cases to maintain a deployment sized for full production volume paid for via a reservation than it would be to scale the deployment with incoming traffic.
8383
> * Having unused provisioned quota (PTUs) does not guarentee that capacity will be available to support increasing the size of the deployment when required. Quota limits the maximum number of PTUs that can be deployed, but it is not a capacity guarantee. Provisioned capacity for each region and modal dynamically changes throughout the day and might not be available when required. As a result, it is recommended to maintain a permanant deployment to cover your traffic needs (paid for via a reservation).
8484
85+
> [!NOTE]
86+
> Charges for deployments on a deleted resource will continue until the resource is purged. To prevent this, delete a resource’s deployment before deleting the resource. For more information, see [Recover or purge deleted Azure AI services resources](../../recover-purge-resources.md).
87+
8588
## Azure Reservations for Azure OpenAI Provisioned  
8689

8790
Discounts on top of the hourly usage price can be obtained by purchasing an Azure Reservation for Azure OpenAI Provisioned. An Azure Reservation is a term-discounting mechanism shared by many Azure products. For example, Compute and Cosmos DB. For Azure OpenAI Provisioned, the reservation provides a discount for committing to payment for fixed number of PTUs for a one-month or one-year period. 
@@ -103,9 +106,11 @@ Discounts on top of the hourly usage price can be obtained by purchasing an Azur
103106
* If the size of provisioned deployments within the scope of a reservation exceeds the amount of the reservation, the excess is charged at the hourly rate. For example, if deployments amounting to 250 PTUs exist within the scope of a 200 PTU reservation, 50 PTUs will be charged on an hourly basis until the deployment sizes are reduced to 200 PTUs, or a new reservation is created to cover the remaining 50.
104107

105108
* Reservations guarantee a discounted price for the selected term.  They do not reserve capacity on the service or guarantee that it will be available when a deployment is created. It is highly recommended that customers create deployments prior to purchasing a reservation to prevent from over-purchasing a reservation.
106-
107-
> [!NOTE]
108-
> The Azure role and tenant policy requirements to purchase a reservation are different than those required to create a deployment or Azure OpenAI resource. See Azure OpenAI [Provisioned reservation documentation](https://aka.ms/oai/docs/ptum-reservations) for more details.
109+
110+
> [!IMPORTANT]
111+
> * Capacity availability for model deployments is dynamic and changes frequently across regions and models. To prevent you from purchasing a reservation for more PTUs than you can use, create deployments first, and then purchase the Azure Reservation to cover the PTUs you have deployed. This best practice will ensure that you can take full advantage of the reservation discount and prevent you from purchasing a term commitment that you cannot use.
112+
>
113+
> * The Azure role and tenant policy requirements to purchase a reservation are different than those required to create a deployment or Azure OpenAI resource. Verify authorization to purchase reservations in advance of needing to do so. See Azure OpenAI [Provisioned reservation documentation](https://aka.ms/oai/docs/ptum-reservations) for more details.
109114
110115
## Important: Sizing Azure OpenAI Provisioned Reservations
111116

@@ -119,7 +124,7 @@ To assist customers with purchasing the correct reservation amounts. The total n
119124

120125
Managing Azure Reservations
121126

122-
After a reservation is created, it is a best practice monitor it to ensure it is receiving the usage you are expecting. This may be done via the Azure Reservation Portal or Azure Monitor. Details on these topics and others can be found here:
127+
After a reservation is created, it is a best practice monitor it to ensure it is receiving the usage you are expecting. This can be done via the Azure Reservation Portal or Azure Monitor. Details on these topics and others can be found here:
123128

124129
* [View Azure reservation utilization](/azure/cost-management-billing/reservations/reservation-utilization)
125130
* [View Azure Reservation purchase and refund transactions](/azure/cost-management-billing/reservations/view-purchase-refunds)
90.8 KB
Loading
-28.4 KB
Loading

articles/ai-services/recover-purge-resources.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: eric-urban
66
manager: nitinme
77
ms.service: azure-ai-services
88
ms.topic: how-to
9-
ms.date: 11/15/2023
9+
ms.date: 09/12/2024
1010
ms.author: eur
1111
---
1212

@@ -17,7 +17,9 @@ This article provides instructions on how to recover or purge an Azure AI servic
1717
Once you delete a resource, you won't be able to create another one with the same name for 48 hours. To create a resource with the same name, you need to purge the deleted resource.
1818

1919
> [!NOTE]
20-
> The instructions in this article are applicable to both a multi-service resource and a single-service resource. A multi-service resource enables access to multiple Azure AI services using a single key and endpoint. On the other hand, a single-service resource enables access to just that specific Azure AI service for which the resource was created.
20+
> * The instructions in this article are applicable to both a multi-service resource and a single-service resource. A multi-service resource enables access to multiple Azure AI services using a single key and endpoint. On the other hand, a single-service resource enables access to just that specific Azure AI service for which the resource was created.
21+
>
22+
> * Charges for provisioned deployments on a deleted resource will continue until the resource is purged. To prevent this, delete a resource's deployment before deleting the resource.
2123
2224
## Recover a deleted resource
2325

0 commit comments

Comments
 (0)