Skip to content

Commit 12377aa

Browse files
committed
update docs regarding fine-tuning model deployment changes
1 parent c5321bb commit 12377aa

File tree

6 files changed

+31
-1
lines changed

6 files changed

+31
-1
lines changed

articles/cognitive-services/openai/concepts/models.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -192,6 +192,8 @@ When using our embeddings models, keep in mind their limitations and risks.
192192
<br><sup>2</sup> East US and West Europe are currently unavailable for new customers to fine-tune due to high demand. Please use US South Central region for fine-tuning.
193193
<br><sup>3</sup> Currently, only version `0301` of this model is available. This version of the model will be deprecated on 8/1/2023 in favor of newer version of the gpt-35-model. See [ChatGPT model versioning](../how-to/chatgpt.md#model-versioning) for more details.
194194

195+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
196+
195197
### GPT-4 Models
196198

197199
| Model ID | Supports Completions | Supports Embeddings | Base model Regions | Fine-Tuning Regions | Max Request (tokens) | Training Data (up to) |
@@ -212,6 +214,8 @@ When using our embeddings models, keep in mind their limitations and risks.
212214
<sup>1</sup> The model is available for fine-tuning by request only. Currently we aren't accepting new requests to fine-tune the model.
213215
<br><sup>2</sup> East US is currently unavailable for new customers to fine-tune due to high demand. Please use US South Central region for US based training.
214216

217+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
218+
215219
### Embeddings Models
216220
| Model ID | Supports Completions | Supports Embeddings | Base model Regions | Fine-Tuning Regions | Max Request (tokens) | Training Data (up to) |
217221
| --- | --- | --- | --- | --- | --- | --- |

articles/cognitive-services/openai/includes/fine-tuning-python.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -237,6 +237,8 @@ print(f'Found {len(result)} fine-tune jobs.')
237237

238238
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the FineTune.retrieve() method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
239239

240+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
241+
240242
> [!NOTE]
241243
> As with all applications, we require a review process prior to going live.
242244

articles/cognitive-services/openai/includes/fine-tuning-rest.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -245,6 +245,8 @@ print(f'Found {len((r.json())["data"])} fine-tune jobs.')
245245

246246
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the `FineTune.retrieve()` method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
247247

248+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
249+
248250
> [!NOTE]
249251
> As with all applications, we require a review process prior to going live.
250252

articles/cognitive-services/openai/includes/fine-tuning-studio.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -241,6 +241,8 @@ From the model page, you can also select **Download training file** to download
241241

242242
When the fine-tune job has succeeded, you can deploy the customized model from the **Models** pane. You must deploy your customized model to make it available for use with completion calls.
243243

244+
[!INCLUDE [Fine-tuning guidance](../includes/fine-tuning.md)]
245+
244246
> [!NOTE]
245247
> Only one deployment is permitted for a customized model. An error message is displayed if you select an already-deployed customized model.
246248
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
title: include file
3+
description: include file
4+
services: cognitive-services
5+
author: mrbullwinkle
6+
ms.service: cognitive-services
7+
ms.topic: include
8+
ms.date: 03/27/2023
9+
ms.author: mbullwin
10+
ms.custom: include
11+
---
12+
13+
> [!NOTE]
14+
> Deployed customized models (fine-tuned models) that are inactive for greater than 90 days will automatically have their deployments deleted. **The underlying fine-tuned model is retained and can be redeployed at any time**. Once a fine-tuned model is deployed, it will continue to incur an hourly hosting cost regardless of whether you're actively using the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).

articles/cognitive-services/openai/whats-new.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.author: mbullwin
88
ms.service: cognitive-services
99
ms.subservice: openai
1010
ms.topic: overview
11-
ms.date: 03/21/2023
11+
ms.date: 03/27/2023
1212
recommendations: false
1313
keywords:
1414
---
@@ -17,6 +17,12 @@ keywords:
1717

1818
## March 2023
1919

20+
### Fine-tuned model change
21+
22+
Deployed customized models (fine-tuned models) that are inactive for greater than 90 days will now automatically have their deployments deleted. **The underlying fine-tuned model is retained and can be redeployed at any time**. Once a fine-tuned model is deployed, it will continue to incur an hourly hosting cost regardless of whether you're actively using the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).
23+
24+
### New Features
25+
2026
- **GPT-4 series models are now available in preview on Azure OpenAI**. To request access, existing Azure OpenAI customers can [apply by filling out this form](https://aka.ms/oai/get-gpt4). These models are currently available in the East US and South Central US regions.
2127

2228
- **New Chat Completion API for ChatGPT and GPT-4 models released in preview on 3/21**. To learn more checkout the [updated quickstarts](./quickstart.md) and [how-to article](./how-to/chatgpt.md).

0 commit comments

Comments
 (0)