Skip to content

Commit 633b77e

Browse files
authored
Merge pull request #232238 from mrbullwinkle/mrb_03_27_2023_fine_tuning
[Cognitive Services] [Azure OpenAI] Fine-tuning model deployment changes
2 parents 4f752ce + b50246f commit 633b77e

File tree

7 files changed

+36
-2
lines changed

7 files changed

+36
-2
lines changed

articles/cognitive-services/openai/concepts/models.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -194,6 +194,8 @@ These models can be used with Completion API requests. `gpt-35-turbo` is the onl
194194
<br><sup>2</sup> East US and West Europe were previously available, but due to high demand they are currently unavailable for new customers to use for fine-tuning. Please use US South Central region for fine-tuning.
195195
<br><sup>3</sup> Currently, only version `0301` of this model is available. This version of the model will be deprecated on 8/1/2023 in favor of newer version of the gpt-35-model. See [ChatGPT model versioning](../how-to/chatgpt.md#model-versioning) for more details.
196196

197+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
198+
197199
### GPT-4 Models
198200

199201
These models can only be used with the Chat Completion API.
@@ -217,6 +219,8 @@ These models can only be used with Completions API requests.
217219

218220
<sup>1</sup> The model is available for fine-tuning by request only. Currently we aren't accepting new requests to fine-tune the model.
219221

222+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
223+
220224
### Embeddings Models
221225

222226
These models can only be used with Embedding API requests.

articles/cognitive-services/openai/faq.yml

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -98,7 +98,11 @@ sections:
9898
What are the SLAs for API responses in Azure OpenAI?
9999
answer:
100100
We don't have a defined API response time Service Level Agreement (SLA) at this time. The overall SLA for Azure OpenAI Service is the same as for other Azure Cognitive Services. For more information, see the Cognitive Services section of the [Service Level Agreements (SLA) for Online Services page](https://azure.microsoft.com/support/legal/sla/cognitive-services/v1_1/).
101-
101+
- question: |
102+
My customized model (fine-tuned model) deployment was deleted, why did this happen?
103+
answer:
104+
Deployed customized models (fine-tuned models) that are inactive for greater than 90 days will automatically have their deployments deleted. **The underlying fine-tuned model is retained and can be redeployed at any time**. Once a fine-tuned model is deployed, it will continue to incur an hourly hosting cost regardless of whether you're actively using the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).
105+
102106
additionalContent: |
103107
104108
## Next steps

articles/cognitive-services/openai/includes/fine-tuning-python.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -237,6 +237,8 @@ print(f'Found {len(result)} fine-tune jobs.')
237237

238238
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the FineTune.retrieve() method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
239239

240+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
241+
240242
> [!NOTE]
241243
> As with all applications, we require a review process prior to going live.
242244

articles/cognitive-services/openai/includes/fine-tuning-rest.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -245,6 +245,8 @@ print(f'Found {len((r.json())["data"])} fine-tune jobs.')
245245

246246
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the `FineTune.retrieve()` method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
247247

248+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
249+
248250
> [!NOTE]
249251
> As with all applications, we require a review process prior to going live.
250252

articles/cognitive-services/openai/includes/fine-tuning-studio.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -241,6 +241,8 @@ From the model page, you can also select **Download training file** to download
241241

242242
When the fine-tune job has succeeded, you can deploy the customized model from the **Models** pane. You must deploy your customized model to make it available for use with completion calls.
243243

244+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
245+
244246
> [!NOTE]
245247
> Only one deployment is permitted for a customized model. An error message is displayed if you select an already-deployed customized model.
246248
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
title: include file
3+
description: include file
4+
services: cognitive-services
5+
author: mrbullwinkle
6+
ms.service: cognitive-services
7+
ms.topic: include
8+
ms.date: 03/27/2023
9+
ms.author: mbullwin
10+
ms.custom: include
11+
---
12+
13+
> [!IMPORTANT]
14+
> Deployed customized models (fine-tuned models) that are inactive for greater than 90 days will automatically have their deployments deleted. **The underlying fine-tuned model is retained and can be redeployed at any time**. Once a fine-tuned model is deployed, it will continue to incur an hourly hosting cost regardless of whether you're actively using the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).

articles/cognitive-services/openai/whats-new.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.author: mbullwin
88
ms.service: cognitive-services
99
ms.subservice: openai
1010
ms.topic: overview
11-
ms.date: 03/21/2023
11+
ms.date: 03/27/2023
1212
recommendations: false
1313
keywords:
1414
---
@@ -17,6 +17,12 @@ keywords:
1717

1818
## March 2023
1919

20+
### Fine-tuned model change
21+
22+
Deployed customized models (fine-tuned models) that are inactive for greater than 90 days will now automatically have their deployments deleted. **The underlying fine-tuned model is retained and can be redeployed at any time**. Once a fine-tuned model is deployed, it will continue to incur an hourly hosting cost regardless of whether you're actively using the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).
23+
24+
### New Features
25+
2026
- **GPT-4 series models are now available in preview on Azure OpenAI**. To request access, existing Azure OpenAI customers can [apply by filling out this form](https://aka.ms/oai/get-gpt4). These models are currently available in the East US and South Central US regions.
2127

2228
- **New Chat Completion API for ChatGPT and GPT-4 models released in preview on 3/21**. To learn more checkout the [updated quickstarts](./quickstart.md) and [how-to article](./how-to/chatgpt.md).

0 commit comments

Comments
 (0)