Skip to content

Commit 3c6057c

Browse files
FillipeMagnomsakande
authored andcommitted
This is the 1st version of the MaaP FT on AI Studio doc.
1 parent b1123ce commit 3c6057c

File tree

4 files changed

+80
-0
lines changed

4 files changed

+80
-0
lines changed
Lines changed: 80 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,80 @@
1+
---
2+
title: Fine-tune models using User-managed compute
3+
titleSuffix: Azure AI Studio
4+
description: Learn how to do fine-tune models using User-managed compute.
5+
manager: scottpolly
6+
ms.service: azure-ai-studio
7+
ms.topic: how-to
8+
ms.date: 10/02/2024
9+
ms.reviewer: vkann
10+
reviewer: kvijaykannan
11+
ms.author: mopeakande
12+
author: msakande
13+
ms.custom: references_regions
14+
15+
#customer intent: As a Data Scientist, I want to learn how to fine-tune models using user managed compute <what> so that <why>
16+
---
17+
18+
# Fine-tune using User-managed compute
19+
20+
In this article
21+
- [Fine-tune using User-managed compute](#distillation)
22+
- [Related Contents](#next-steps)
23+
24+
25+
## How to fine-tune foundation models using your own training data
26+
27+
In order to improve model performance in your workload, you might want to fine tune a foundation model using your own training data. You can easily fine-tune these foundation models by using either the fine-tune settings in the studio or by using the code based samples.
28+
29+
## Fine-tune using the User-managed compute
30+
31+
You can access the fine-tune settings form using one of the following methods:
32+
1. Choose the "Fine-Tuning" option from the left menu, and then select any foundation model.
33+
34+
2. Choose the "Model Card" option from the left menu for any foundation model, and then click the ‘Fine-tune’ button on the model card.
35+
Select the suitable Service method to fine-tune your model. You can choose between 'Hosted fine-tuning' or 'User-managed compute'. If you intend to use your own compute resources, select the 'User-managed compute' option. To learn more about Fine-tuning using Serverless API, refer to the related content articles.
36+
37+
38+
> [!NOTE]
39+
> Some foundation models support only the 'User-managed compute' option.
40+
41+
![Fine tune options in AI Studio](./fine-tune-options.png)
42+
43+
### Fine-tune Settings:
44+
45+
#### Basic Settings
46+
47+
- In the basic settings, provide a name for the fine-tuned model.
48+
49+
#### Compute
50+
51+
- Provide the Azure Machine Learning Compute cluster you would like to use for fine-tuning the model. Fine-tuning needs to run on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you wish to use.
52+
53+
![Fine tune compute in AI Studio](./fine-tune-compute.png)
54+
55+
#### Training Data
56+
57+
1. Pass in the training data you would like to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your workspace.
58+
59+
2. Once you've selected the dataset, you need to map the columns from your input data, based on the schema needed for the task. For example: map the column names that correspond to the 'sentence' and 'label' keys for Text Classification.
60+
61+
![Fine tune training data in AI Studio](./fine-tune-training-data.jpeg)
62+
63+
64+
#### Validation data
65+
66+
- Pass in the data you would like to use to validate your model. Selecting Automatic split reserves an automatic split of training data for validation. Alternatively, you can provide a different validation dataset.
67+
68+
#### Test Parameters
69+
70+
- Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate.
71+
72+
#### Review
73+
74+
- Select Finish in the fine-tune form to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing.
75+
76+
## Related Contents
77+
- [Fine-tuning in Azure AI Studio - Azure AI Studio | Microsoft Learn](../fine-tuning-overview.md)
78+
- [Fine-tune a Llama 2 model in Azure AI Studio](../fine-tune-model-llama.md)
79+
- [Fine-tune a Phi-3 model in Azure AI Studio](../fine-tune-phi-3.md)
80+
- [Deploy Phi-3 family of small language models with Azure AI Studio](../deploy-models-phi-3.md)
189 KB
Loading
135 KB
Loading
325 KB
Loading

0 commit comments

Comments
 (0)