We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 009712d commit e03f595Copy full SHA for e03f595
articles/ai-services/openai/how-to/fine-tuning.md
@@ -143,6 +143,8 @@ Users can use preference fine tuning with base models as well as models that hav
143
144
### How to use direct preference optimization fine-tuning?
145
146
+ :::image type="content" border="true" source="/azure/ai-services/openai/media/fine-tuning/preference-optimization.gif" alt-text="GIF of preference optimization fine-tuning steps.":::
147
+
148
1. Prepare `jsonl` datasets in the [preference format](#direct-preference-optimization-dataset-format).
149
2. Select the model and then select the method of customization **Direct Preference Optimization**.
150
3. Upload datasets – training and validation. Preview as needed.
articles/ai-services/openai/media/fine-tuning/preference-optimization.gif
109 KB
0 commit comments