You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/openai/includes/fine-tuning-studio.md
+25-25Lines changed: 25 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: 'Customize a model with Azure OpenAI Service and Azure OpenAI Studio'
2
+
title: 'Customize a model with Azure OpenAI Service and Azure AI Studio'
3
3
titleSuffix: Azure OpenAI
4
-
description: Learn how to create your own custom model with Azure OpenAI Service by using the Azure OpenAI Studio.
4
+
description: Learn how to create your own custom model with Azure OpenAI Service by using the Azure AI Studio.
5
5
#services: cognitive-services
6
6
manager: nitinme
7
7
ms.service: azure-ai-openai
@@ -17,7 +17,7 @@ ms.author: mbullwin
17
17
- An Azure subscription. <ahref="https://azure.microsoft.com/free/cognitive-services"target="_blank">Create one for free</a>.
18
18
- An Azure OpenAI resource that's located in a region that supports fine-tuning of the Azure OpenAI model. Check the [Model summary table and region availability](../concepts/models.md#fine-tuning-models) for the list of available models by region and supported functionality. For more information, see [Create a resource and deploy a model with Azure OpenAI](../how-to/create-resource.md).
- If you do not already have access to view quota, and deploy models in Azure OpenAI Studio you will require [additional permissions](../how-to/role-based-access-control.md).
20
+
- If you do not already have access to view quota, and deploy models in Azure AI Studio you will require [additional permissions](../how-to/role-based-access-control.md).
21
21
22
22
## Models
23
23
@@ -40,12 +40,12 @@ Or you can fine tune a previously fine-tuned model, formatted as base-model.ft-{
40
40
Consult the [models page](../concepts/models.md#fine-tuning-models) to check which regions currently support fine-tuning.
41
41
42
42
43
-
## Review the workflow for Azure OpenAI Studio
43
+
## Review the workflow for Azure AI Studio
44
44
45
-
Take a moment to review the fine-tuning workflow for using Azure OpenAI Studio:
45
+
Take a moment to review the fine-tuning workflow for using Azure AI Studio:
46
46
47
47
1. Prepare your training and validation data.
48
-
1. Use the **Create custom model** wizard in Azure OpenAI Studio to train your custom model.
48
+
1. Use the **Create custom model** wizard in Azure AI Studio to train your custom model.
49
49
1.[Select a base model](#select-the-base-model).
50
50
1.[Choose your training data](#choose-your-training-data).
51
51
1. Optionally, [choose your validation data](#choose-your-validation-data).
@@ -144,13 +144,13 @@ After it guides you through the process of implementing suggested changes, the t
144
144
145
145
## Use the Create custom model wizard
146
146
147
-
Azure OpenAI Studio provides the **Create custom model** wizard, so you can interactively create and train a fine-tuned model for your Azure resource.
147
+
Azure AI Studio provides the **Create custom model** wizard, so you can interactively create and train a fine-tuned model for your Azure resource.
148
148
149
-
1. Open Azure OpenAI Studio at <ahref="https://oai.azure.com/"target="_blank">https://oai.azure.com/</a> and sign in with credentials that have access to your Azure OpenAI resource. During the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.
149
+
1. Open Azure AI Studio at <ahref="https://oai.azure.com/"target="_blank">https://oai.azure.com/</a> and sign in with credentials that have access to your Azure OpenAI resource. During the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.
150
150
151
-
1. In Azure OpenAI Studio, browse to the **Tools > Fine-tuning** pane, and select **Fine-tune model**.
151
+
1. In Azure AI Studio, browse to the **Tools > Fine-tuning** pane, and select **Fine-tune model**.
152
152
153
-
:::image type="content" source="../media/fine-tuning/studio-create-custom-model.png" alt-text="Screenshot that shows how to access the Create custom model wizard in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-create-custom-model.png":::
153
+
:::image type="content" source="../media/fine-tuning/studio-create-custom-model.png" alt-text="Screenshot that shows how to access the Create custom model wizard in Azure AI Studio." lightbox="../media/fine-tuning/studio-create-custom-model.png":::
154
154
155
155
The **Create custom model** wizard opens.
156
156
@@ -179,7 +179,7 @@ For more information about our base models that can be fine-tuned, see [Models](
179
179
180
180
The next step is to either choose existing prepared training data or upload new prepared training data to use when customizing your model. The **Training data** pane displays any existing, previously uploaded datasets and also provides options to upload new training data.
181
181
182
-
:::image type="content" source="../media/fine-tuning/studio-training-data.png" alt-text="Screenshot of the Training data pane for the Create custom model wizard in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-training-data.png":::
182
+
:::image type="content" source="../media/fine-tuning/studio-training-data.png" alt-text="Screenshot of the Training data pane for the Create custom model wizard in Azure AI Studio." lightbox="../media/fine-tuning/studio-training-data.png":::
183
183
184
184
- If your training data is already uploaded to the service, select **Files from Azure OpenAI Connection**.
185
185
@@ -228,7 +228,7 @@ The next step provides options to configure the model to use validation data in
228
228
229
229
The **Validation data** pane displays any existing, previously uploaded training and validation datasets and provides options by which you can upload new validation data.
230
230
231
-
:::image type="content" source="../media/fine-tuning/studio-validation-data.png" alt-text="Screenshot of the Validation data pane for the Create custom model wizard in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-validation-data.png":::
231
+
:::image type="content" source="../media/fine-tuning/studio-validation-data.png" alt-text="Screenshot of the Validation data pane for the Create custom model wizard in Azure AI Studio." lightbox="../media/fine-tuning/studio-validation-data.png":::
232
232
233
233
- If your validation data is already uploaded to the service, select **Choose dataset**.
234
234
@@ -293,15 +293,15 @@ After you configure the advanced options, select **Next** to [review your choice
293
293
294
294
The **Review** pane of the wizard displays information about your configuration choices.
295
295
296
-
:::image type="content" source="../media/fine-tuning/studio-review.png" alt-text="Screenshot of the Review pane for the Create custom model wizard in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-review.png":::
296
+
:::image type="content" source="../media/fine-tuning/studio-review.png" alt-text="Screenshot of the Review pane for the Create custom model wizard in Azure AI Studio." lightbox="../media/fine-tuning/studio-review.png":::
297
297
298
298
If you're ready to train your model, select **Start Training job** to start the fine-tuning job and return to the **Models** pane.
299
299
300
300
## Check the status of your custom model
301
301
302
302
The **Models** pane displays information about your custom model in the **Customized models** tab. The tab includes information about the status and job ID of the fine-tune job for your custom model. When the job completes, the tab displays the file ID of the result file. You might need to select **Refresh** in order to see an updated status for the model training job.
303
303
304
-
:::image type="content" source="../media/fine-tuning/studio-models-job-running.png" alt-text="Screenshot of the Models pane from Azure OpenAI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
304
+
:::image type="content" source="../media/fine-tuning/studio-models-job-running.png" alt-text="Screenshot of the Models pane from Azure AI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
305
305
306
306
After you start a fine-tuning job, it can take some time to complete. Your job might be queued behind other jobs on the system. Training your model can take minutes or hours depending on the model and dataset size.
307
307
@@ -317,7 +317,7 @@ Here are some of the tasks you can do on the **Models** pane:
317
317
318
318
- Select **Refresh** to update the information on the page.
319
319
320
-
:::image type="content" source="../media/fine-tuning/studio-model-details.png" alt-text="Screenshot of the Models pane in Azure OpenAI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
320
+
:::image type="content" source="../media/fine-tuning/studio-model-details.png" alt-text="Screenshot of the Models pane in Azure AI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
321
321
322
322
## Checkpoints
323
323
@@ -339,13 +339,13 @@ When the fine-tuning job succeeds, you can deploy the custom model from the **Mo
339
339
340
340
To deploy your custom model, select the custom model to deploy, and then select **Deploy model**.
341
341
342
-
:::image type="content" source="../media/fine-tuning/studio-models-deploy-model.png" alt-text="Screenshot that shows how to deploy a custom model in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-models-deploy-model.png":::
342
+
:::image type="content" source="../media/fine-tuning/studio-models-deploy-model.png" alt-text="Screenshot that shows how to deploy a custom model in Azure AI Studio." lightbox="../media/fine-tuning/studio-models-deploy-model.png":::
343
343
344
344
The **Deploy model** dialog box opens. In the dialog box, enter your **Deployment name** and then select **Create** to start the deployment of your custom model.
345
345
346
-
:::image type="content" source="../media/fine-tuning/studio-models-deploy.png" alt-text="Screenshot of the Deploy Model dialog in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-models-deploy.png":::
346
+
:::image type="content" source="../media/fine-tuning/studio-models-deploy.png" alt-text="Screenshot of the Deploy Model dialog in Azure AI Studio." lightbox="../media/fine-tuning/studio-models-deploy.png":::
347
347
348
-
You can monitor the progress of your deployment on the **Deployments** pane in Azure OpenAI Studio.
348
+
You can monitor the progress of your deployment on the **Deployments** pane in Azure AI Studio.
349
349
350
350
### Cross region deployment
351
351
@@ -357,13 +357,13 @@ Cross subscription/region deployment can be accomplished via [Python](/azure/ai-
357
357
358
358
## Use a deployed custom model
359
359
360
-
After your custom model deploys, you can use it like any other deployed model. You can use the **Playgrounds** in [Azure OpenAI Studio](https://oai.azure.com) to experiment with your new deployment. You can continue to use the same parameters with your custom model, such as `temperature` and `max_tokens`, as you can with other deployed models. For fine-tuned `babbage-002` and `davinci-002` models you will use the Completions playground and the Completions API. For fine-tuned `gpt-35-turbo-0613` models you will use the Chat playground and the Chat completion API.
360
+
After your custom model deploys, you can use it like any other deployed model. You can use the **Playgrounds** in [Azure AI Studio](https://oai.azure.com) to experiment with your new deployment. You can continue to use the same parameters with your custom model, such as `temperature` and `max_tokens`, as you can with other deployed models. For fine-tuned `babbage-002` and `davinci-002` models you will use the Completions playground and the Completions API. For fine-tuned `gpt-35-turbo-0613` models you will use the Chat playground and the Chat completion API.
361
361
362
-
:::image type="content" source="../media/quickstarts/playground-load-new.png" alt-text="Screenshot of the Playground pane in Azure OpenAI Studio, with sections highlighted." lightbox="../media/quickstarts/playground-load-new.png":::
362
+
:::image type="content" source="../media/quickstarts/playground-load-new.png" alt-text="Screenshot of the Playground pane in Azure AI Studio, with sections highlighted." lightbox="../media/quickstarts/playground-load-new.png":::
363
363
364
364
## Analyze your custom model
365
365
366
-
Azure OpenAI attaches a result file named _results.csv_ to each fine-tuning job after it completes. You can use the result file to analyze the training and validation performance of your custom model. The file ID for the result file is listed for each custom model in the **Result file Id** column on the **Models** pane for Azure OpenAI Studio. You can use the file ID to identify and download the result file from the **Data files** pane of Azure OpenAI Studio.
366
+
Azure OpenAI attaches a result file named _results.csv_ to each fine-tuning job after it completes. You can use the result file to analyze the training and validation performance of your custom model. The file ID for the result file is listed for each custom model in the **Result file Id** column on the **Models** pane for Azure AI Studio. You can use the file ID to identify and download the result file from the **Data files** pane of Azure AI Studio.
367
367
368
368
The result file is a CSV file that contains a header row and a row for each training step performed by the fine-tuning job. The result file contains the following columns:
369
369
@@ -377,7 +377,7 @@ The result file is a CSV file that contains a header row and a row for each trai
377
377
|`full_valid_loss`| The validation loss calculated at the end of each epoch. When training goes well, loss should decrease. |
378
378
|`full_valid_mean_token_accuracy`| The valid mean token accuracy calculated at the end of each epoch. When training is going well, token accuracy should increase. |
379
379
380
-
You can also view the data in your results.csv file as plots in Azure OpenAI Studio. Select the link for your trained model, and you will see three charts: loss, mean token accuracy, and token accuracy. If you provided validation data, both datasets will appear on the same plot.
380
+
You can also view the data in your results.csv file as plots in Azure AI Studio. Select the link for your trained model, and you will see three charts: loss, mean token accuracy, and token accuracy. If you provided validation data, both datasets will appear on the same plot.
381
381
382
382
Look for your loss to decrease over time, and your accuracy to increase. If you see a divergence between your training and validation data, that may indicate that you are overfitting. Try training with fewer epochs, or a smaller learning rate multiplier.
383
383
@@ -389,18 +389,18 @@ When you're done with your custom model, you can delete the deployment and model
389
389
390
390
[!INCLUDE [Fine-tuning deletion](fine-tune.md)]
391
391
392
-
You can delete the deployment for your custom model on the **Deployments** pane in Azure OpenAI Studio. Select the deployment to delete, and then select **Delete** to delete the deployment.
392
+
You can delete the deployment for your custom model on the **Deployments** pane in Azure AI Studio. Select the deployment to delete, and then select **Delete** to delete the deployment.
393
393
394
394
### Delete your custom model
395
395
396
-
You can delete a custom model on the **Models** pane in Azure OpenAI Studio. Select the custom model to delete from the **Customized models** tab, and then select **Delete** to delete the custom model.
396
+
You can delete a custom model on the **Models** pane in Azure AI Studio. Select the custom model to delete from the **Customized models** tab, and then select **Delete** to delete the custom model.
397
397
398
398
> [!NOTE]
399
399
> You can't delete a custom model if it has an existing deployment. You must first [delete your model deployment](#delete-your-model-deployment) before you can delete your custom model.
400
400
401
401
### Delete your training files
402
402
403
-
You can optionally delete training and validation files that you uploaded for training, and result files generated during training, on the **Management** > **Data files** pane in Azure OpenAI Studio. Select the file to delete, and then select **Delete** to delete the file.
403
+
You can optionally delete training and validation files that you uploaded for training, and result files generated during training, on the **Management** > **Data files** pane in Azure AI Studio. Select the file to delete, and then select **Delete** to delete the file.
0 commit comments