You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
> Azure Reservations for Azure OpenAI Provisioned offers are not interchangeable across deployment types. The Azure Reservation purchased must match the provisioned deployment type. If the Azure Reservation purchased does not match the provisioned deployment type, the provisioned deployment will default to the hourly payment model until a matching Azure Reservation product is purchased. For more information, see the [Azure Reservations for Azure OpenAI Service Provisioned guidance](https://aka.ms/oai/docs/ptum-reservations).
48
+
> Azure Reservations for Azure OpenAI provisioned offers are not interchangeable across deployment types. The Azure Reservation purchased must match the provisioned deployment type. If the Azure Reservation purchased does not match the provisioned deployment type, the provisioned deployment will default to the hourly payment model until a matching Azure Reservation product is purchased. For more information, see the [Azure Reservations for Azure OpenAI Service Provisioned guidance](https://aka.ms/oai/docs/ptum-reservations).
49
49
50
50
## Migrating existing deployments to Global or Data zone provisioned
51
-
Existing customers of provisioned deployments can choose to migrate to Global or Data zone provisioned deployments to benefit from the lower deployment minimums, granular scale increments, or differentiated pricing available for these deployment types. To learn more about how Global and Data zone provisioned deployments handle data processing across Azure geographies, see the Azure OpenAI deployment [data processing documentation](https://aka.ms/aoai/docs/data-processing-locations).
51
+
Existing customers of provisioned deployments can choose to migrate to global or data zone provisioned deployments to benefit from the lower deployment minimums, granular scale increments, or differentiated pricing available for these deployment types. To learn more about how global and data zone provisioned deployments handle data processing across Azure geographies, see the Azure OpenAI deployment [data processing documentation](https://aka.ms/aoai/docs/data-processing-locations).
52
52
53
-
Two approaches are available for customers to migrate from provisioned deployments to Global or Data zone provisioned deployments.
53
+
Two approaches are available for customers to migrate from provisioned deployments to global or data zone provisioned deployments.
54
54
55
55
### Zero downtime migration
56
56
The zero downtime migration approach allows customers to migrate their existing provisioned deployments to Global or Data zone provisioned deployments without interrupting the existing inference traffic on their deployment. This migration approach minimizes workload interruptions but does require a customer to coexist multiple deployments to shift traffic over. The process to migrate a provisioned deployment using the zero downtime migration approach is as follows:
57
-
- Create a new deployment using the `GlobalProvisionedManaged` or `DataZoneProvisionedManaged` deployment types in the target Azure OpenAI resource.
58
-
- Transition traffic from the existing `ProvisionedManaged`deployment type to the newly created `GlobalProvisionedManaged` or `DataZoneProvisionedManaged`deployment until all traffic is offloaded from the existing `ProvisionedManaged` deployment.
59
-
- Once traffic is migrated over to the new deployment, validate that there are no inference requests being processed on the previous `ProvisionedManaged` deployment by ensuring the Azure OpenAI Requests metric ([see Monitor Azure OpenAI](https://aka.ms/aoai/docs/monitor-azure-openai) for more details on this metric) does not show any API calls made within 5-10 minutes of the inference traffic being migrated over to the new deployment.
60
-
- Once you confirm that no inference calls have been made on the previous `ProvisionedManaged` deployment, delete the `ProvisionedManaged`deployment.
57
+
- Create a new deployment using the global or data zone provisioned deployment types in the target Azure OpenAI resource.
58
+
- Transition traffic from the existing regional provisioned deployment type to the newly created global or data zone provisioned deployment until all traffic is offloaded from the existing regional provisioned deployment.
59
+
- Once traffic is migrated over to the new deployment, validate that there are no inference requests being processed on the previous provisioned deployment by ensuring the Azure OpenAI Requests metric does not show any API calls made within 5-10 minutes of the inference traffic being migrated over to the new deployment. For more information on this metric, [see the Monitor Azure OpenAI documentation](https://aka.ms/aoai/docs/monitor-azure-openai).
60
+
- Once you confirm that no inference calls have been made, delete the regional provisioned deployment.
61
61
62
62
### Migration with downtime
63
-
The migration with downtime approach involves migrating existing provisioned deployments to Global or Data zone provisioned deployments while stopping any exisitng inference traffic on the original provisioned deployment. This migration approach does not require coexistence of multiple deployments to support but does require workload interruption to complete. The process to migration a provisioned deployment using the migration with downtime approach is as follows:
64
-
- Validate that there are no inference requests being processed on the previous `ProvisionedManaged` deployment by ensuring the Azure OpenAI Requests metric ([see Monitor Azure OpenAI](https://aka.ms/aoai/docs/monitor-azure-openai) for more details on this metric) does not show any API calls made within the last 5-10 minutes.
65
-
- Once you confirm that no inference calls have been made on your `ProvisionedManaged` deployment, delete the `ProvisionedManaged` deployment.
66
-
- Create a new deployment using the `GlobalProvisionedManaged` or `DataZoneProvisionedManaged` deployment types in the target Azure OpenAI resource.
67
-
- Once your new deployment has succeeded, you may resume inference traffic on the new `GlobalProvisionedManaged` or `DataZoneProvisionedManaged` deployment.
63
+
The migration with downtime approach involves migrating existing provisioned deployments to global or data zone provisioned deployments while stopping any exisitng inference traffic on the original provisioned deployment. This migration approach does not require coexistence of multiple deployments to support but does require workload interruption to complete. The process to migrate a provisioned deployment using the migration with downtime approach is as follows:
64
+
- Validate that there are no inference requests being processed on the previous provisioned deployment by ensuring the Azure OpenAI Requests metric does not show any API calls made within the last 5-10 minutes. For more information on this metric, [see the Monitor Azure OpenAI documentation](https://aka.ms/aoai/docs/monitor-azure-openai).
65
+
- Once you confirm that no inference calls have been made, delete the regional provisioned deployment.
66
+
- Create a new deployment using the global or data zone deployment types in the target Azure OpenAI resource.
67
+
- Once your new deployment has succeeded, you may resume inference traffic on the new global or data zone deployment.
68
68
69
69
## How do I migrate my existing Azure Reservation to the new Azure Reservation products?
70
-
As noted above, Azure Reservation products for Azure OpenAI Service provisioned will be specific to the provisioned deployment type. If the Azure Reservation purhcased does not match the provisioned deployment type, the deployment will default to the hourly payment model. If you choose to migrate to Global or Data zone provisioned deployments, you may need to purchase a new Azure Reservation for these deployments to support additional discounts. For more information on how to purchase a new Azure Reservation or make changes to an existing Azure Reservation, see the [Azure Reservations for Azure OpenAI Service Provisioned guidance](https://aka.ms/oai/docs/ptum-reservations).
70
+
Azure Reservations for Azure OpenAI Service provisioned offers are specific to the provisioned deployment type. If the Azure Reservation purchased does not match the provisioned deployment type, the deployment will default to the hourly payment model. If you choose to migrate to global or data zone provisioned deployments, you may need to purchase a new Azure Reservation for these deployments to support additional discounts. For more information on how to purchase a new Azure Reservation or make changes to an existing Azure Reservation, see the [Azure Reservations for Azure OpenAI Service Provisioned guidance](https://aka.ms/oai/docs/ptum-reservations).
0 commit comments