You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -86,7 +86,7 @@ These models can only be used with the Chat Completion API.
86
86
|`gpt-4-32k` (0613) | Australia East<sup>1</sup>, Canada East, East US<sup>1</sup>, East US 2<sup>1</sup>, France Central<sup>1</sup>, Japan East<sup>1</sup>, Sweden Central, Switzerland North, UK South<sup>1</sup> | N/A | 32,768 | September 2021 |
87
87
88
88
<sup>1</sup> Due to high demand, availability is limited in the region<br>
89
-
<sup>2</sup> Version `0314` of gpt-4 and gpt-4-32k will be retired no earlier than July 5, 2024. See [model updates](#model-updates) for model upgrade behavior.<br>
89
+
<sup>2</sup> Version `0314` of gpt-4 and gpt-4-32k will be retired no earlier than July 5, 2024. See [model updates](../how-to/working-with-models.md#model-updates) for model upgrade behavior.<br>
90
90
91
91
### GPT-3.5 models
92
92
@@ -99,7 +99,7 @@ GPT-3.5 Turbo is used with the Chat Completion API. GPT-3.5 Turbo (0301) can als
99
99
|`gpt-35-turbo-16k` (0613) | Australia East, Canada East, East US, East US 2, France Central, Japan East, North Central US, Sweden Central, Switzerland North, UK South | N/A | 16,384 | Sep 2021 |
100
100
|`gpt-35-turbo-instruct` (0914) | East US, Sweden Central | N/A | 4,097 | Sep 2021 |
101
101
102
-
<sup>1</sup> Version `0301` of gpt-35-turbo will be retired no earlier than July 5, 2024. See [model updates](#model-updates) for model upgrade behavior.
102
+
<sup>1</sup> Version `0301` of gpt-35-turbo will be retired no earlier than July 5, 2024. See [model updates](../how-to/working-with-models.md#model-updates) for model upgrade behavior.
103
103
104
104
### Embeddings models
105
105
@@ -125,204 +125,8 @@ These models can only be used with Embedding API requests.
125
125
| --- | --- | --- | --- | --- |
126
126
| whisper | North Central US, West Europe | N/A | 25 MB | N/A |
127
127
128
-
## Working with models
129
-
130
-
### Finding what models are available
131
-
132
-
You can get a list of models that are available for both inference and fine-tuning by your Azure OpenAI resource by using the [Models List API](/rest/api/cognitiveservices/azureopenaistable/models/list).
133
-
134
-
### Model updates
135
-
136
-
Azure OpenAI now supports automatic updates for select model deployments. On models where automatic update support is available, a model version drop-down will be visible in Azure OpenAI Studio under **Create new deployment** and **Edit deployment**:
137
-
138
-
:::image type="content" source="../media/models/auto-update.png" alt-text="Screenshot of the deploy model UI of Azure OpenAI Studio." lightbox="../media/models/auto-update.png":::
139
-
140
-
### Auto update to default
141
-
142
-
When **Auto-update to default** is selected your model deployment will be automatically updated within two weeks of a change in the default version.
143
-
144
-
If you are still in the early testing phases for inference models, we recommend deploying models with **auto-update to default** set whenever it is available.
145
-
146
-
### Specific model version
147
-
148
-
As your use of Azure OpenAI evolves, and you start to build and integrate with applications you may want to manually control model updates so that you can first test and validate that model performance is remaining consistent for your use case prior to upgrade.
149
-
150
-
When you select a specific model version for a deployment this version will remain selected until you either choose to manually update yourself, or once you reach the retirement date for the model. When the retirement date is reached the model will auto-upgrade to the default version at the time of retirement.
151
-
152
-
### GPT-35-Turbo 0301 and GPT-4 0314 retirement
153
-
154
-
The `gpt-35-turbo` (`0301`) and both `gpt-4` (`0314`) models will be retired no earlier than July 5, 2024. Upon retirement, deployments will automatically be upgraded to the default version at the time of retirement. If you would like your deployment to stop accepting completion requests rather than upgrading, then you will be able to set the model upgrade option to expire through the API. We will publish guidelines on this by September 1.
155
-
156
-
### Viewing deprecation dates
157
-
158
-
For currently deployed models, from Azure OpenAI Studio select **Deployments**:
159
-
160
-
:::image type="content" source="../media/models/deployments.png" alt-text="Screenshot of the deployment UI of Azure OpenAI Studio." lightbox="../media/models/deployments.png":::
161
-
162
-
To view deprecation/expiration dates for all available models in a given region from Azure OpenAI Studio select **Models** > **Column options** > Select **Deprecation fine tune** and **Deprecation inference**:
163
-
164
-
:::image type="content" source="../media/models/column-options.png" alt-text="Screenshot of the models UI of Azure OpenAI Studio." lightbox="../media/models/column-options.png":::
165
-
166
-
### Model deployment upgrade configuration
167
-
168
-
There are three distinct model deployment upgrade options which are configurable via REST API:
169
-
170
-
| Name | Description |
171
-
|------|--------|
172
-
|`OnceNewDefaultVersionAvailable`| Once a new version is designated as the default, the model deployment will auto-upgrade to the default version within two weeks of that designation change being made. |
173
-
`OnceCurrentVersionExpired` | Once the retirement date is reached the model deployment will auto-upgrade to the current default version. |
174
-
`NoAutoUpgrade` | The model deployment will never auto-upgrade. Once the retirement date is reached the model deployment will stop working. You will need to update your code referencing that deployment to point to a non-expired model deployment. |
175
-
176
-
To query the current model deployment settings including the deployment upgrade configuration for a given resource use [`Deployments List`](/rest/api/cognitiveservices/accountmanagement/deployments/list?tabs=HTTP#code-try-0)
177
-
178
-
```http
179
-
GET https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.CognitiveServices/accounts/{accountName}/deployments?api-version=2023-05-01
180
-
```
181
-
182
-
**Path parameters**
183
-
184
-
| Parameter | Type | Required? | Description |
185
-
|--|--|--|--|
186
-
|```acountname```| string | Required | The name of your Azure OpenAI Resource. |
187
-
|```resourceGroupName```| string | Required | The name of the associated resource group for this model deployment. |
188
-
|```subscriptionId```| string | Required | Subscription ID for the associated subscription. |
189
-
|```api-version```| string | Required |The API version to use for this operation. This follows the YYYY-MM-DD format. |
You can then take the settings from this list to construct an update model REST API call as described below if you want to modify the deployment upgrade configuration.
235
-
236
-
### Update & deploy models via the API
237
-
238
-
```http
239
-
PUT https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.CognitiveServices/accounts/{accountName}/deployments/{deploymentName}?api-version=2023-05-01
240
-
```
241
-
242
-
**Path parameters**
243
-
244
-
| Parameter | Type | Required? | Description |
245
-
|--|--|--|--|
246
-
|```acountname```| string | Required | The name of your Azure OpenAI Resource. |
247
-
|```deploymentName```| string | Required | The deployment name you chose when you deployed an existing model or the name you would like a new model deployment to have. |
248
-
|```resourceGroupName```| string | Required | The name of the associated resource group for this model deployment. |
249
-
|```subscriptionId```| string | Required | Subscription ID for the associated subscription. |
250
-
|```api-version```| string | Required |The API version to use for this operation. This follows the YYYY-MM-DD format. |
This is only a subset of the available request body parameters. For the full list of the parameters, you can refer to the [REST API reference documentation](/rest/api/cognitiveservices/accountmanagement/deployments/create-or-update).
259
-
260
-
|Parameter|Type| Description |
261
-
|--|--|--|
262
-
|versionUpgradeOption | String | Deployment model version upgrade options:<br>`OnceNewDefaultVersionAvailable`<br>`OnceCurrentVersionExpired`<br>`NoAutoUpgrade`|
263
-
|capacity|integer|This represents the amount of [quota](../how-to/quota.md) you are assigning to this deployment. A value of 1 equals 1,000 Tokens per Minute (TPM)|
264
-
265
-
#### Example request
266
-
267
-
```Bash
268
-
curl -X PUT https://management.azure.com/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/resource-group-temp/providers/Microsoft.CognitiveServices/accounts/docs-openai-test-001/deployments/text-embedding-ada-002-test-1?api-version=2023-05-01 \
> There are multiple ways to generate an authorization token. The easiest method for initial testing is to launch the Cloud Shell from the [Azure portal](https://portal.azure.com). Then run [`az account get-access-token`](/cli/azure/account?view=azure-cli-latest#az-account-get-access-token&preserve-view=true). You can use this token as your temporary authorization token for API testing.
0 commit comments