File tree Expand file tree Collapse file tree 2 files changed +0
-4
lines changed
articles/ai-services/openai Expand file tree Collapse file tree 2 files changed +0
-4
lines changed Original file line number Diff line number Diff line change @@ -143,16 +143,12 @@ Users can use preference fine tuning with base models as well as models that hav
143
143
144
144
### How to use direct preference optimization fine-tuning?
145
145
146
- :::image type="content" source="../media/fine-tuning/preference-fine-tuning.gif" alt-text="Gif demonstrating the steps for preference fine-tuning" lightbox="../media/fine-tuning/preference-fine-tuning.gif":::
147
-
148
146
1 . Prepare ` jsonl ` datasets in the [ preference format] ( #direct-preference-optimization-dataset-format ) .
149
147
2 . Select the model and then select the method of customization ** Direct Preference Optimization**
150
148
3 . Upload datasets – training and validation. Preview as needed.
151
149
4 . Select hyperparameters, defaults are recommended for initial experimentation.
152
150
5 . Review the selections and create fine tuning job.
153
151
154
-
155
-
156
152
## Troubleshooting
157
153
158
154
### How do I enable fine-tuning?
You can’t perform that action at this time.
0 commit comments