Skip to content

Commit 24d8d94

Browse files
authored
Merge pull request #277242 from mrbullwinkle/mrb_06_05_2024_checkpoints
[Azure OpenAI] Checkpoints update
2 parents 6ab992a + 2e115f7 commit 24d8d94

File tree

4 files changed

+14
-1
lines changed

4 files changed

+14
-1
lines changed

articles/ai-services/openai/includes/fine-tuning-openai-in-ai-studio.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -242,10 +242,18 @@ The result file is a CSV file that contains a header row and a row for each trai
242242
| `full_valid_loss` | The validation loss calculated at the end of each epoch. When training goes well, loss should decrease. |
243243
|`full_valid_mean_token_accuracy` | The valid mean token accuracy calculated at the end of each epoch. When training is going well, token accuracy should increase. |
244244

245-
You can also view the data in your results.csv file as plots in Azure AI Studio under the **Metrics** tab of your fine-tuned model. Select the link for your trained model, and you will see three charts: loss, mean token accuracy, and token accuracy. If you provided validation data, both datasets will appear on the same plot.
245+
You can also view the data in your results.csv file as plots in Azure AI Studio under the **Metrics** tab of your fine-tuned model. Select the link for your trained model, and you will see two charts: loss, and token accuracy. If you provided validation data, both datasets will appear on the same plot.
246+
247+
:::image type="content" source="../media/fine-tuning/metrics.png" alt-text="Screenshot of metrics UI." lightbox="../media/fine-tuning/metrics.png":::
246248

247249
Look for your loss to decrease over time, and your accuracy to increase. If you see a divergence between your training and validation data that may indicate that you are overfitting. Try training with fewer epochs, or a smaller learning rate multiplier.
248250

251+
## Checkpoints
252+
253+
When each training epoch completes a checkpoint is generated. A checkpoint is a fully functional version of a model which can both be deployed and used as the target model for subsequent fine-tuning jobs. Checkpoints can be particularly useful, as they can provide a snapshot of your model prior to overfitting having occurred. When a fine-tuning job completes you will have the three most recent versions of the model available to deploy.
254+
255+
:::image type="content" source="../media/fine-tuning/checkpoints.png" alt-text="Screenshot of checkpoints UI." lightbox="../media/fine-tuning/checkpoints.png":::
256+
249257
## Safety evaluation GPT-4 fine-tuning - public preview
250258

251259
[!INCLUDE [Safety evaluation](../includes/safety-evaluation.md)]

articles/ai-services/openai/includes/fine-tuning-studio.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -317,6 +317,11 @@ Here are some of the tasks you can do on the **Models** pane:
317317

318318
:::image type="content" source="../media/fine-tuning/studio-model-details.png" alt-text="Screenshot of the Models pane in Azure OpenAI Studio, with a custom model displayed." lightbox="../media/fine-tuning/studio-models-job-running.png":::
319319

320+
## Checkpoints
321+
322+
When each training epoch completes a checkpoint is generated. A checkpoint is a fully functional version of a model which can both be deployed and used as the target model for subsequent fine-tuning jobs. Checkpoints can be particularly useful, as they can provide a snapshot of your model prior to overfitting having occurred. When a fine-tuning job completes you will have the three most recent versions of the model available to deploy.
323+
324+
320325
## Safety evaluation GPT-4 fine-tuning - public preview
321326

322327
[!INCLUDE [Safety evaluation](../includes/safety-evaluation.md)]
287 KB
Loading
470 KB
Loading

0 commit comments

Comments
 (0)