Skip to content

Commit 28100e5

Browse files
Merge pull request #256610 from mrbullwinkle/mrb_10_30_2023_working_with_model_updates
[Azure OpenAI] Working with Model updates
2 parents 11dbca1 + fb9455d commit 28100e5

File tree

1 file changed

+44
-3
lines changed

1 file changed

+44
-3
lines changed

articles/ai-services/openai/concepts/model-versions.md

Lines changed: 44 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ titleSuffix: Azure OpenAI
44
description: Learn about model versions in Azure OpenAI.
55
ms.service: azure-ai-openai
66
ms.topic: conceptual
7-
ms.date: 10/13/2023
7+
ms.date: 10/30/2023
88
ms.custom:
99
manager: nitinme
1010
author: mrbullwinkle #ChrisHMSFT
@@ -18,6 +18,7 @@ keywords:
1818
Azure OpenAI Service is committed to providing the best generative AI models for customers. As part of this commitment, Azure OpenAI Service regularly releases new model versions to incorporate the latest features and improvements from OpenAI.
1919

2020
In particular, the GPT-3.5 Turbo and GPT-4 models see regular updates with new features. For example, versions 0613 of GPT-3.5 Turbo and GPT-4 introduced function calling. Function calling is a popular feature that allows the model to create structured outputs that can be used to call external tools.
21+
2122
## How model versions work
2223

2324
We want to make it easy for customers to stay up to date as models improve. Customers can choose to start with a particular version and to automatically update as new versions are released.
@@ -26,10 +27,50 @@ When a customer deploys GPT-3.5-Turbo and GPT-4 on Azure OpenAI Service, the sta
2627

2728
Customers can also deploy a specific version like GPT-4 0314 or GPT-4 0613 and choose an update policy, which can include the following options:
2829

29-
* Deployments set to **Auto-update to default** automatically update to use the new default version.
30-
* Deployments set to **Upgrade when expired** automatically update when its current version is retired.
30+
* Deployments set to **Auto-update to default** automatically update to use the new default version.
31+
* Deployments set to **Upgrade when expired** automatically update when its current version is retired.
3132
* Deployments that are set to **No Auto Upgrade** stop working when the model is retired.
3233

34+
### VersionUpgradeOption
35+
36+
You can check what model upgrade options are set for previously deployed models in [Azure OpenAI Studio](https://oai.azure.com). Select **Deployments** > Under the deployment name column select one of the deployment names that are highlighted in blue > The **Properties** will contain a value for **Version update policy**.
37+
38+
The corresponding property can also be accessed via [REST](../how-to/working-with-models.md#model-deployment-upgrade-configuration), [Azure PowerShell](/powershell/module/az.cognitiveservices/get-azcognitiveservicesaccountdeployment), and [Azure CLI](/cli/azure/cognitiveservices/account/deployment#az-cognitiveservices-account-deployment-show).
39+
40+
|Option| Read | Update |
41+
|---|---|---|
42+
| [REST](../how-to/working-with-models.md#model-deployment-upgrade-configuration) | Yes. If `versionUpgradeOption` is not returned it means it is `null` |Yes |
43+
| [Azure PowerShell](/powershell/module/az.cognitiveservices/get-azcognitiveservicesaccountdeployment) | Yes.`VersionUpgradeOption` can be checked for `$null`| Yes |
44+
| [Azure CLI](/cli/azure/cognitiveservices/account/deployment#az-cognitiveservices-account-deployment-show) | Yes. It shows `null` if `versionUpgradeOption` is not set.| *No.* It is currently not possible to update the version upgrade option.|
45+
46+
> [!NOTE]
47+
> `null` is equivalent to `AutoUpgradeWhenExpired`.
48+
49+
**Azure PowerShell**
50+
51+
Review the Azure PowerShell [getting started guide](/powershell/azure/get-started-azureps) to install Azure PowerShell locally or you can use the [Azure Cloud Shell](/azure/cloud-shell/overview).
52+
53+
The steps below demonstrate checking the `VersionUpgradeOption` option property as well as updating it:
54+
55+
```powershell
56+
// Step 1: Get Deployment
57+
$deployment = Get-AzCognitiveServicesAccountDeployment -ResourceGroupName {ResourceGroupName} -AccountName {AccountName} -Name {DeploymentName}
58+
59+
// Step 2: Show Deployment VersionUpgradeOption
60+
$deployment.Properties.VersionUpgradeOption
61+
62+
// VersionUpgradeOption can be null - one way to check is
63+
$null -eq $deployment.Properties.VersionUpgradeOption
64+
65+
// Step 3: Update Deployment VersionUpgradeOption
66+
$deployment.Properties.VersionUpgradeOption = "NoAutoUpgrade"
67+
New-AzCognitiveServicesAccountDeployment -ResourceGroupName {ResourceGroupName} -AccountName {AccountName} -Name {DeploymentName} -Properties $deployment.Properties -Sku $deployment.Sku
68+
69+
// repeat step 1 and 2 to confirm the change.
70+
// If not sure about deployment name, use this command to show all deployments under an account
71+
Get-AzCognitiveServicesAccountDeployment -ResourceGroupName {ResourceGroupName} -AccountName {AccountName}
72+
```
73+
3374
## How Azure updates OpenAI models
3475

3576
Azure works closely with OpenAI to release new model versions. When a new version of a model is released, a customer can immediately test it in new deployments. Azure publishes when new versions of models are released, and notifies customers at least two weeks before a new version becomes the default version of the model. Azure also maintains the previous major version of the model until its retirement date, so customers can switch back to it if desired.

0 commit comments

Comments
 (0)