You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/openai/includes/fine-tuning-python.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -92,10 +92,10 @@ The first step in creating a customized model is to choose a base model. The cho
92
92
-`ada`
93
93
-`babbage`
94
94
-`curie`
95
-
-`code-cushman-001`\__*__
96
-
-`davinci`\__*__
95
+
-`code-cushman-001`__\*__
96
+
-`davinci`__\*__
97
97
98
-
\__*__An asterisk indicates the model is currently unavailable for new customers.
98
+
__\*__This model is currently unavailable for new customers.
99
99
100
100
You can use the [Models API](/rest/api/cognitiveservices/azureopenaistable/models/list) to identify which models are fine-tunable. For more information about our base models, see [Models](../concepts/models.md).
101
101
@@ -334,7 +334,7 @@ The result file is a CSV file that contains a header row and a row for each trai
334
334
| --- | --- |
335
335
|`step`| The number of the training step. A training step represents a single pass, forward and backward, on a batch of training data. |
336
336
|`elapsed_tokens`| The number of tokens the customized model has seen so far, including repeats. |
337
-
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#choose-advanced-options), this value increments by 32 in each training step. |
337
+
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#configure-advanced-options), this value increments by 32 in each training step. |
338
338
|`training_loss`| The loss for the training batch. |
339
339
|`training_sequence_accuracy`| The percentage of completions in the training batch for which the model's predicted tokens exactly matched the true completion tokens.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.67 (2 of 3) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
340
340
|`training_token_accuracy`| The percentage of tokens in the training batch correctly predicted by the model.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.83 (5 of 6) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
Copy file name to clipboardExpand all lines: articles/ai-services/openai/includes/fine-tuning-rest.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -92,10 +92,10 @@ The first step in creating a customized model is to choose a base model. The cho
92
92
-`ada`
93
93
-`babbage`
94
94
-`curie`
95
-
-`code-cushman-001`\__*__
96
-
-`davinci`\__*__
95
+
-`code-cushman-001`__\*__
96
+
-`davinci`__\*__
97
97
98
-
\__*__An asterisk indicates the model is currently unavailable for new customers.
98
+
__\*__This model is currently unavailable for new customers.
99
99
100
100
You can use the [Models API](/rest/api/cognitiveservices/azureopenaistable/models/list) to identify which models are fine-tunable. For more information about our base models, see [Models](../concepts/models.md).
101
101
@@ -371,7 +371,7 @@ The result file is a CSV file that contains a header row and a row for each trai
371
371
| --- | --- |
372
372
|`step`| The number of the training step. A training step represents a single pass, forward and backward, on a batch of training data. |
373
373
|`elapsed_tokens`| The number of tokens the customized model has seen so far, including repeats. |
374
-
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#choose-advanced-options), this value increments by 32 in each training step. |
374
+
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#configure-advanced-options), this value increments by 32 in each training step. |
375
375
|`training_loss`| The loss for the training batch. |
376
376
|`training_sequence_accuracy`| The percentage of completions in the training batch for which the model's predicted tokens exactly matched the true completion tokens.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.67 (2 of 3) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
377
377
|`training_token_accuracy`| The percentage of tokens in the training batch correctly predicted by the model.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.83 (5 of 6) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
Copy file name to clipboardExpand all lines: articles/ai-services/openai/includes/fine-tuning-studio.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,7 +31,7 @@ Take a moment to review the fine-tuning workflow for using Azure OpenAI Studio w
31
31
1.[Select a base model](#select-a-base-model).
32
32
1.[Choose your training data](#choose-your-training-data).
33
33
1. Optionally, [choose your validation data](#choose-your-validation-data).
34
-
1. Optionally, [choose advanced options](#choose-advanced-options) for your fine-tune job.
34
+
1. Optionally, [choose advanced options](#configure-advanced-options) for your fine-tune job.
35
35
1.[Review your choices and train your new custom model](#review-your-choices-and-train-your-model).
36
36
1. Check the status of your custom model.
37
37
1. Deploy your custom model for use.
@@ -94,7 +94,7 @@ Azure OpenAI Studio provides the **Create custom model** wizard, so you can inte
94
94
95
95
1. Open Azure OpenAI Studio at <ahref="https://oai.azure.com/"target="_blank">https://oai.azure.com/</a> and sign in with credentials that have access to your Azure OpenAI resource. During the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.
96
96
97
-
1. In Azure OpenAI Studio, browse to the **Management > Models**page, and select **Create a custom model**.
97
+
1. In Azure OpenAI Studio, browse to the **Management > Models**pane, and select **Create a custom model**.
98
98
99
99
> [!NOTE]
100
100
> If your resource doesn't have a model already deployed in it, a warning is displayed. For this exercise, you can ignore the warning because you fine-tune and deploy a new custom model.
@@ -133,9 +133,9 @@ The next step is to either choose existing prepared training data or upload new
133
133
134
134
- To upload new training data, use one of the following options:
135
135
136
-
- Select **Local file** to [upload training data from a local file](#to-upload-training-data-from-a-local-file).
136
+
- Select **Local file** to [upload training data from a local file](#upload-training-data-from-local-file).
137
137
138
-
- Select **Azure blob or other shared web locations** to [import training data from Azure Blob or another shared web location](#to-import-training-data-from-an-azure-blob-store).
138
+
- Select **Azure blob or other shared web locations** to [import training data from Azure Blob or another shared web location](#import-training-data-from-azure-blob-store).
139
139
140
140
For large data files, we recommend you import from an Azure Blob store. Large files can become unstable when uploaded through multipart forms because the requests are atomic and can't be retried or resumed. For more information about Azure Blob Storage, see [What is Azure Blob Storage](../../../storage/blobs/storage-blobs-overview.md)?
141
141
@@ -182,9 +182,9 @@ The **Validation data** pane displays any existing, previously uploaded training
182
182
183
183
- To upload new validation data, use one of the following options:
184
184
185
-
- Select **Local file** to [upload validation data from a local file](#to-upload-validation-data-from-a-local-file).
185
+
- Select **Local file** to [upload validation data from a local file](#upload-validation-data-from-local-file).
186
186
187
-
- Select **Azure blob or other shared web locations** to [import validation data from Azure Blob or another shared web location](#to-import-validation-data-from-an-azure-blob-store).
187
+
- Select **Azure blob or other shared web locations** to [import validation data from Azure Blob or another shared web location](#import-validation-data-from-azure-blob-store).
188
188
189
189
For large data files, we recommend you import from an Azure Blob store. Large files can become unstable when uploaded through multipart forms because the requests are atomic and can't be retried or resumed.
190
190
@@ -240,19 +240,19 @@ For more information about the hyperparameters, see the [Create a Fine tune job]
240
240
241
241
After you configure the advanced options, select **Next** to [review your choices and train your fine-tuned model](#review-your-choices-and-train-your-model).
242
242
243
-
### Review your choices
243
+
### Review your choices and train your model
244
244
245
245
The **Review** pane of the wizard displays information about your configuration choices.
246
246
247
247
:::image type="content" source="../media/fine-tuning/studio-review.png" alt-text="Screenshot of the Review pane for the Create custom model wizard in Azure OpenAI Studio." lightbox="../media/fine-tuning/studio-review.png":::
248
248
249
-
If you're ready to train your model, select **Save and close** to start the fine-tune job and return to the [**Models**page](#start-the-wizard-from-the-models-page).
249
+
If you're ready to train your model, select **Save and close** to start the fine-tune job and return to the **Models**pane.
250
250
251
251
## Check the status of your custom model
252
252
253
-
The **Models**page displays information about your custom model in the **Customized models** tab. The tab includes information about the status and job ID of the fine-tune job for your custom model. When the job is completed, the file ID of the result file is also displayed.
253
+
The **Models**pane displays information about your custom model in the **Customized models** tab. The tab includes information about the status and job ID of the fine-tune job for your custom model. When the job is completed, the file ID of the result file is also displayed.
254
254
255
-
:::image type="content" source="../media/fine-tuning/studio-models-job-running.png" alt-text="Screenshot of the Models page from Azure OpenAI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
255
+
:::image type="content" source="../media/fine-tuning/studio-models-job-running.png" alt-text="Screenshot of the Models pane from Azure OpenAI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
256
256
257
257
After you start a fine-tune job, it can take some time to complete. Your job might be queued behind other jobs on our system, and training your model can take minutes or hours depending on the model and dataset size.
258
258
@@ -308,7 +308,7 @@ The result file is a CSV file that contains a header row and a row for each trai
308
308
| --- | --- |
309
309
|`step`| The number of the training step. A training step represents a single pass, forward and backward, on a batch of training data. |
310
310
|`elapsed_tokens`| The number of tokens the custom model has seen so far, including repeats. |
311
-
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#choose-advanced-options), this value increments by 32 in each training step. |
311
+
|`elapsed_examples`| The number of examples the model has seen so far, including repeats.<br>Each example represents one element in that step's batch of training data. For example, if the `Batch size` parameter is set to 32 in the [**Advanced options** pane](#configure-advanced-options), this value increments by 32 in each training step. |
312
312
|`training_loss`| The loss for the training batch. |
313
313
|`training_sequence_accuracy`| The percentage of completions in the training batch for which the model's predicted tokens exactly matched the true completion tokens.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.67 (2 of 3) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
314
314
|`training_token_accuracy`| The percentage of tokens in the training batch correctly predicted by the model.<br>For example, if the batch size is set to 3 and your data contains completions `[[1, 2], [0, 5], [4, 2]]`, this value is set to 0.83 (5 of 6) if the model predicted `[[1, 1], [0, 5], [4, 2]]`. |
0 commit comments