Skip to content

Commit 18335a2

Browse files
author
Jill Grant
authored
Merge pull request #2054 from mrbullwinkle/mrb_12_17_2024_fine_tuning_image
[Azure OpenAI] DPO add GIF
2 parents cdc253a + ba7316b commit 18335a2

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

articles/ai-services/openai/how-to/fine-tuning.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -143,6 +143,8 @@ Users can use preference fine tuning with base models as well as models that hav
143143

144144
### How to use direct preference optimization fine-tuning?
145145

146+
:::image type="content" border="true" source="/azure/ai-services/openai/media/fine-tuning/preference-optimization.gif" alt-text="GIF of preference optimization fine-tuning steps.":::
147+
146148
1. Prepare `jsonl` datasets in the [preference format](#direct-preference-optimization-dataset-format).
147149
2. Select the model and then select the method of customization **Direct Preference Optimization**.
148150
3. Upload datasets – training and validation. Preview as needed.
3.1 MB
Loading

0 commit comments

Comments
 (0)