Adding finetuning samples and tests #43749
Conversation
jayesh-tanna
requested review from
dargilco,
glharper,
howieleung,
nick863 and
trangevi
as code owners
API Change CheckAPIView identified API level changes in this PR and created the following API reviews |
|
|
||
| Before running the sample: | ||
|
|
||
| pip install azure-ai-projects azure-identity openai python-dotenv |
There was a problem hiding this comment.
Please use this in the pip install command (all samples): "azure-ai-projects>=2.0.0b1"
| Supported OSS models with SFT technique: Ministral-3b , Llama-3.3-70b , Qwen3-32b , Gpt-oss-20b | ||
|
|
||
| USAGE: | ||
| python sample_finetuning_supervised_job.py |
There was a problem hiding this comment.
Update sample name to match actual file name. Please check other samples as well. Thanks!
| """ | ||
| DESCRIPTION: | ||
| Given an AIProjectClient, this sample demonstrates how to use the synchronous | ||
| `.fine_tuning.jobs` methods to create supervised fine-tuning jobs using OSS model. |
There was a problem hiding this comment.
Can you expand OSS? write "Open Source Software (OSS)"... if I got it correct.
| `.fine_tuning.jobs` methods to create, get, list, cancel, pause, resume, list events and list checkpoints supervised fine-tuning jobs. | ||
| It also shows how to deploy the fine-tuned model using Azure Cognitive Services Management Client and perform inference on the deployed model. | ||
| Supported OAI Models: GPT 4o, 4o-mini, 4.1, 4.1-mini | ||
|
|
There was a problem hiding this comment.
Perhaps shorter lines above (break up long line into two). Same in other samples.
| 2) MODEL_NAME - Optional. The base model name to use for fine-tuning. Default to the `gpt-4o` model. | ||
| 3) TRAINING_FILE_PATH - Optional. Path to the training data file. Default to the `data` folder. | ||
| 4) VALIDATION_FILE_PATH - Optional. Path to the validation data file. Default to the `data` folder. | ||
| """ |
There was a problem hiding this comment.
Can you please update .env.template with placeholders for these env variables? (and a comment line mentioning that these are used by Fine Tuning samples)
|
Please update https://microsoft-my.sharepoint.com/:x:/p/dcohen/IQBab1pCpJAkQ7e-XPUpXiOuAY_le6sw3t0VvKnsNu6YMjQ?e=YHam4v&nav=MTVfezAwMDAwMDAwLTAwMDEtMDAwMC0wMDAwLTAwMDAwMDAwMDAwMH0 when you are done to reflect the status after your PR completes. Thanks! |
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new API spec, a link to the pull request containing these API spec changes should be included above.
All SDK Contribution checklist:
General Guidelines and Best Practices
Testing Guidelines