You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/openai/how-to/fine-tuning.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -70,8 +70,8 @@ If your file upload fails, you can view the error message under “data files”
70
70
71
71
-**Bad data:** A poorly curated or unrepresentative dataset will produce a low-quality model. Your model may learn inaccurate or biased patterns from your dataset. For example, if you are training a chatbot for customer service, but only provide training data for one scenario (e.g. item returns) it will not know how to respond to other scenarios. Or, if your training data is bad (contains incorrect responses), your model will learn to provide incorrect results.
72
72
73
-
74
73
## Next steps
75
74
76
75
- Explore the fine-tuning capabilities in the [Azure OpenAI fine-tuning tutorial](../tutorials/fine-tune.md).
Copy file name to clipboardExpand all lines: articles/ai-services/openai/includes/fine-tuning-openai-in-ai-studio.md
+7-16Lines changed: 7 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
-
title: include file
3
-
description: include file
2
+
title: Include file
3
+
description: Include file
4
4
author: mrbullwinkle
5
5
ms.author: mbullwin
6
6
ms.service: azure-ai-studio
@@ -17,7 +17,7 @@
17
17
- An Azure OpenAI resource that's located in a region that supports fine-tuning of the Azure OpenAI model. Check the [Model summary table and region availability](../concepts/models.md#fine-tuning-models) for the list of available models by region and supported functionality. For more information, see [Create a resource and deploy a model with Azure OpenAI](../how-to/create-resource.md).
18
18
- Fine-tuning access requires **Cognitive Services OpenAI Contributor** role on the Azure OpenAI resource.
19
19
- If you don't already have access to view quota and deploy models in Azure AI Studio you need [more permissions](../how-to/role-based-access-control.md).
20
-
- An Azure AI project (https://learn.microsoft.com/en-us/azure/ai-studio/how-to/create-projects) with a connection to the Azure OpenAI resource (https://learn.microsoft.com/en-us/azure/ai-studio/how-to/connections-add?tabs=azure-openai#connection-details)
20
+
- An Azure AI project (/azure/ai-studio/how-to/create-projects) with a connection to the Azure OpenAI resource (/azure/ai-studio/how-to/connections-add?tabs=azure-openai#connection-details)
21
21
22
22
> [!NOTE]
23
23
> Currently, you must submit an application to access Azure OpenAI Service. To apply for access, complete [this form](https://aka.ms/oai/access).
@@ -61,7 +61,7 @@ Different model types require a different format of training data.
61
61
62
62
The training and validation data you use **must** be formatted as a JSON Lines (JSONL) document. For `gpt-35-turbo-0613` the fine-tuning dataset must be formatted in the conversational format that is used by the [Chat completions](../how-to/chatgpt.md) API.
63
63
64
-
If you would like a step-by-step walk-through of fine-tuning a `gpt-35-turbo-0613` model please refer to the [Azure OpenAI fine-tuning tutorial](../tutorials/fine-tune.md)
64
+
If you would like a step-by-step walk-through of fine-tuning a `gpt-35-turbo-0613` model please refer to the [Azure OpenAI fine-tuning tutorial.](../tutorials/fine-tune.md)
65
65
66
66
### Example file format
67
67
@@ -164,7 +164,7 @@ To fine-tune an Azure OpenAI model in an existing Azure AI Studio project, follo
164
164
### Choose your training data
165
165
The next step is to either choose existing prepared training data or upload new prepared training data to use when customizing your model. The **Training data** pane displays any existing, previously uploaded datasets and also provides options to upload new training data.
166
166
167
-
:::image type="content" source="../media/fine-tuning/studio-training-data.png" alt-text="Screenshot of the Training data pane for the Fine-tune model wizard in Azure AI Studio." lightbox="../media/fine-tuning/ai-studio/training-data.png":::
167
+
:::image type="content" source="../media/fine-tuning/studio-training-data-local.png" alt-text="Screenshot of the Training data pane for the Fine-tune model wizard in Azure AI Studio." lightbox="../media/fine-tuning/ai-studio/training-data-local.png":::
168
168
169
169
- If your training data is already in your project, select **Data in Azure AI Studio**.
170
170
@@ -177,7 +177,7 @@ The next step is to either choose existing prepared training data or upload new
177
177
- For large data files, we recommend that you import from an Azure Blob store. Large files can become unstable when uploaded through multipart forms because the requests are atomic and can't be retried or resumed. For more information about Azure Blob Storage, see [What is Azure Blob Storage](../../../storage/blobs/storage-blobs-overview.md)?
178
178
> [!NOTE]
179
179
> Training data files must be formatted as JSONL files, encoded in UTF-8 with a byte-order mark (BOM). The file must be less than 512 MB in size.
180
-
:::image type="content" source="../media/fine-tuning/ai-studio/fine-tune-training-data.png" alt-text="Screenshot of option to upload training data locally." lightbox="../media/fine-tuning/ai-studio/fine-tune-training-data-local.png":::
180
+
:::image type="content" source="../media/fine-tuning/ai-studio/fine-tune-training-data-preview.png" alt-text="Screenshot of option to upload training data locally." lightbox="../media/fine-tuning/ai-studio/fine-tune-training-data-preview.png":::
181
181
182
182
After uploading files, you will see a preview of your training data. Select **Next** to continue.
183
183
@@ -209,9 +209,6 @@ You can choose to leave the default configuration or customize the values to you
209
209
210
210
Review your choices and select **Submit** to start training your new fine-tuned model.
211
211
212
-
:::image type="content" source="../media/fine-tuning/ai-studio/fine-tune-review-settings.png" alt-text="Screenshot of the review fine-tuning settings page." lightbox="../media/fine-tuning/ai-studio/fine-tune-review-settings.png":::
213
-
214
-
215
212
## Check the status of your fine-tuned model
216
213
217
214
After you submit your fine-tuning job, you see a page with details about your fine-tuned model. You can find the status and more information about your fine-tuned model on the **Build** > **Fine-tuning** > **Models** page in Azure AI Studio.
@@ -238,7 +235,7 @@ The result file is a CSV file that contains a header row and a row for each trai
238
235
239
236
You can also view the data in your results.csv file as plots in Azure AI Studio under the **Metrics** tab of your fine-tuned model. Select the link for your trained model, and you will see three charts: loss, mean token accuracy, and token accuracy. If you provided validation data, both datasets will appear on the same plot.
240
237
241
-
Look for your loss to decrease over time, and your accuracy to increase. If you see a divergence between your training and validation data, that may indicate that you are overfitting. Try training with fewer epochs, or a smaller learning rate multiplier.
238
+
Look for your loss to decrease over time, and your accuracy to increase. If you see a divergence between your training and validation data that may indicate that you are overfitting. Try training with fewer epochs, or a smaller learning rate multiplier.
242
239
243
240
## Deploy a fine-tuned model
244
241
@@ -278,9 +275,3 @@ You can delete a fine-tuned model on the **Fine-tuning** page in Azure AI Studio
278
275
### Delete your training files
279
276
280
277
You can optionally delete training and validation files that you uploaded for training, and result files generated during training. For this you need to go to Azure OpenAI Studio and navigate to the **Management** > **Data files** pane. Select the file to delete, and then select **Delete** to delete the file.
281
-
282
-
## Next steps
283
-
284
-
- Explore the fine-tuning capabilities in the [Azure OpenAI fine-tuning tutorial](../tutorials/fine-tune.md).
0 commit comments