Skip to content

Commit bcf65fb

Browse files
committed
update regarding deletion of inactive fine-tuned deployments
1 parent a0f9fc4 commit bcf65fb

File tree

7 files changed

+35
-4
lines changed

7 files changed

+35
-4
lines changed

articles/cognitive-services/openai/concepts/models.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -250,4 +250,5 @@ These models can only be used with Embedding API requests.
250250

251251
## Next steps
252252

253-
[Learn more about Azure OpenAI](../overview.md)
253+
- [Learn more about Azure OpenAI](../overview.md)
254+
- [Learn more about fine-tuning Azure OpenAI models](../how-to/fine-tuning.md)

articles/cognitive-services/openai/how-to/fine-tuning.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ manager: nitinme
77
ms.service: cognitive-services
88
ms.subservice: openai
99
ms.topic: how-to
10-
ms.date: 12/14/2022
10+
ms.date: 04/05/2023
1111
author: ChrisHMSFT
1212
ms.author: chrhoder
1313
zone_pivot_groups: openai-fine-tuning

articles/cognitive-services/openai/how-to/manage-costs.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.custom: subject-cost-optimization
77
ms.service: cognitive-services
88
ms.subservice: openai
99
ms.topic: how-to
10-
ms.date: 02/13/2023
10+
ms.date: 04/05/2023
1111
---
1212

1313

@@ -49,6 +49,8 @@ Azure OpenAI fine-tuned models are charged based on three factors:
4949

5050
The hosting hours cost is important to be aware of since once a fine-tuned model is deployed it continues to incur an hourly cost regardless of whether you're actively using it. Fine-tuned model costs should be monitored closely.
5151

52+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
53+
5254
### Other costs that might accrue with Azure OpenAI Service
5355

5456
Keep in mind that enabling capabilities like sending data to Azure Monitor Logs, alerting, etc. incurs additional costs for those services. These costs are visible under those other services and at the subscription level, but aren't visible when scoped just to your Azure OpenAI resource.
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
---
2+
title: Fine-tuning inactivity guidance
3+
titleSuffix: Azure OpenAI
4+
description: Fine-tuning inactivity guidance
5+
author: mrbullwinkle
6+
ms.author: mbullwin
7+
ms.service: cognitive-services
8+
ms.topic: include
9+
ms.date: 04/05/2023
10+
manager: nitinme
11+
keywords: ChatGPT
12+
13+
---
14+
15+
> [!IMPORTANT]
16+
> After a customized model is deployed, if at any time the deployment remains inactive for greater than fifteen (15) days, the deployment will automatically be deleted. The deployment of a customized model is “inactive” if the model was deployed more than fifteen (15) days ago and no completions or chat completions calls were made to it during a continuous 15-day period. The deletion of an inactive deployment does **NOT** delete or affect the underlying customized model, and the customized model can be redeployed at any time. As described in [Azure OpenAI Service pricing](https://azure.microsoft.com/pricing/details/cognitive-services/openai-service/), each customized (fine-tuned) model that is deployed incurs an hourly hosting cost regardless of whether completions or chat completions calls are being made to the model. To learn more about planning and managing costs with Azure OpenAI, refer to our [cost management guide](/azure/cognitive-services/openai/how-to/manage-costs#base-series-and-codex-series-fine-tuned-models).

articles/cognitive-services/openai/includes/fine-tuning-python.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ manager: nitinme
77
ms.service: cognitive-services
88
ms.subservice: openai
99
ms.topic: how-to
10-
ms.date: 06/30/2022
10+
ms.date: 04/05/2023
1111
author: ChrisHMSFT
1212
ms.author: chrhoder
1313
keywords:
@@ -237,6 +237,8 @@ print(f'Found {len(result)} fine-tune jobs.')
237237

238238
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the FineTune.retrieve() method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
239239

240+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
241+
240242
> [!NOTE]
241243
> As with all applications, we require a review process prior to going live.
242244
@@ -344,6 +346,8 @@ When you're done with your customized model, you can delete the deployment and m
344346

345347
### Delete your model deployment
346348

349+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
350+
347351
You can use various methods to delete the deployment for your customized model:
348352

349353
- [Azure OpenAI Studio](../how-to/fine-tuning.md?pivots=programming-language-studio#delete-your-model-deployment)</a>

articles/cognitive-services/openai/includes/fine-tuning-rest.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -245,6 +245,8 @@ print(f'Found {len((r.json())["data"])} fine-tune jobs.')
245245

246246
When the fine-tune job has succeeded, the value of `fine_tuned_model` in the response body of the `FineTune.retrieve()` method is set to the name of your customized model. Your model is now also available for discovery from the [list Models API](/rest/api/cognitiveservices/azureopenaistable/models/list). However, you can't issue completion calls to your customized model until your customized model is deployed. You must deploy your customized model to make it available for use with completion calls.
247247

248+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
249+
248250
> [!NOTE]
249251
> As with all applications, we require a review process prior to going live.
250252
@@ -380,6 +382,8 @@ When you're done with your customized model, you can delete the deployment and m
380382

381383
### Delete your model deployment
382384

385+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
386+
383387
You can use various methods to delete the deployment for your customized model:
384388

385389
- [Azure OpenAI Studio](../how-to/fine-tuning.md?pivots=programming-language-studio#delete-your-model-deployment)

articles/cognitive-services/openai/includes/fine-tuning-studio.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -241,6 +241,8 @@ From the model page, you can also select **Download training file** to download
241241

242242
When the fine-tune job has succeeded, you can deploy the customized model from the **Models** pane. You must deploy your customized model to make it available for use with completion calls.
243243

244+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
245+
244246
> [!NOTE]
245247
> Only one deployment is permitted for a customized model. An error message is displayed if you select an already-deployed customized model.
246248
@@ -287,6 +289,8 @@ When you're done with your customized model, you can delete the deployment and m
287289

288290
### Delete your model deployment
289291

292+
[!INCLUDE [Fine-tuning deletion](../includes/fine-tune.md.md)]
293+
290294
You can delete the deployment for your customized model from the **Deployments** page for Azure OpenAI Studio. Select the deployment to delete, and then select **Delete** to delete the deployment.
291295

292296
### Delete your customized model

0 commit comments

Comments
 (0)