Skip to content

Commit 1f75c53

Browse files
authored
Add sample CLI section for fine-tuning
1 parent b41a20e commit 1f75c53

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

articles/ai-studio/how-to/fine-tune-serverless.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -90,6 +90,7 @@ The supported file type is JSON Lines. Files are uploaded to the default datasto
9090
The training and validation data you use **must** be formatted as a JSON Lines (JSONL) document in which each line represents a single prompt-completion pair.
9191

9292
### Example file format
93+
9394
```json
9495
{"prompt": "<prompt text>", "completion": "<ideal generated text>"}
9596
{"prompt": "<prompt text>", "completion": "<ideal generated text>"}
@@ -188,6 +189,16 @@ For more information on how to track costs, see [Monitor costs for models offere
188189

189190
You can use this [sample notebook](https://github.com/Azure/azureml-examples/blob/main/sdk/python/jobs/finetuning/standalone/chat-completion/chat_completion_with_model_as_service.ipynb) to create a standalone fine-tuning job to enhance a model's ability to summarize dialogues between two people using the Samsum dataset. The training data utilized is the ultrachat_200k dataset, which is divided into four splits suitable for supervised fine-tuning (sft) and generation ranking (gen). The notebook employs the available Azure AI models for the chat-completion task (If you would like to use a different model than what's used in the notebook, you can replace the model name). The notebook includes setting up prerequisites, selecting a model to fine-tune, creating training and validation datasets, configuring and submitting the fine-tuning job, and finally, creating a serverless deployment using the fine-tuned model for sample inference.
190191

192+
## Sample CLI
193+
194+
Additionally, you can use this sample CLI to create a standalone fine-tuning job to enhance a model's ability to summarize dialogues between two people using a dataset.
195+
196+
::: zone pivot="programming-language-cli"
197+
[!INCLUDE [cli](cli/jobs/finetuning/standalone/model-as-a-service/chat-completion/chat-completion-finetuning.yaml)]
198+
::: zone-end
199+
200+
The training data used is the same as demonstrated in the SDK notebook. The CLI employs the available Azure AI models for the chat-completion task. If you prefer to use a different model than the one in the CLI sample, you can update the arguments, such as 'model path,' accordingly
201+
191202
## Content filtering
192203

193204
Models deployed as a service with pay-as-you-go billing are protected by Azure AI Content Safety. When deployed to real-time endpoints, you can opt out of this capability. With Azure AI content safety enabled, both the prompt and completion pass through an ensemble of classification models aimed at detecting and preventing the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Learn more about [Azure AI Content Safety](../concepts/content-filtering.md).

0 commit comments

Comments
 (0)