You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/fine-tune-managed-compute.md
+24-27Lines changed: 24 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ ms.custom: references_regions
17
17
18
18
# Fine-tune models using user-managed compute
19
19
20
-
This article explains how to use a user-managed compute fine-tune a machine learning model in Azure AI Studio. Fine-tuning involves adapting a pretrained model to a new, related task or domain. WHen you use a managed compute for fine-tuning, you use your computational resources to adjust training parameters such as learning rate, batch size, and number of training epochs to optimize the model's performance for a specific task. Fine-tuning a pretrained model to use for a related task is more efficient than building a new model, as it builds upon the pretrained model's existing knowledge and reduces the time and data needed for training.
20
+
This article explains how to use a user-managed compute to fine-tune a foundation model in Azure AI Studio. Fine-tuning involves adapting a pretrained model to a new, related task or domain. When you use a managed compute for fine-tuning, you use your computational resources to adjust training parameters such as learning rate, batch size, and number of training epochs to optimize the model's performance for a specific task. Fine-tuning a pretrained model to use for a related task is more efficient than building a new model, as it builds upon the pretrained model's existing knowledge and reduces the time and data needed for training.
21
21
22
22
To improve model performance, you might consider fine-tuning a foundation model with your training data. You can easily fine-tune foundation models by using either the fine-tune settings in AI Studio or by using code-based samples.
23
23
@@ -31,54 +31,51 @@ __Todo: link to the code-based samples__
31
31
32
32
- An [Azure AI Studio project](create-projects.md).
33
33
34
-
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription.
34
+
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. For more information on permissions, see [Role-based access control in Azure AI Studio](../concepts/rbac-ai-studio.md).
35
35
36
-
## Fine-tune using user-managed compute in
36
+
## Fine-tune a foundation model using managed compute
37
37
38
-
You can access the fine-tune settings form using one of the following methods:
39
-
1. Choose the "Fine-Tuning" option from the left menu, and then select any foundation model.
38
+
1. Sign in to [Azure AI Studio](https://ai.azure.com).
39
+
1. Select **Fine-tuning** from the left sidebar and add the foundation model that you want to finetune.
40
+
1. Alternatively, you could select **Model catalog** from the left sidebar and find the model card of the foundation model that you want to finetune.
41
+
1. Select __Fine-tune__ on the model card to see the available fine-tune options. Some foundation models support only the __User-managed compute__ option.
42
+
1. Select the __User-managed compute__ option to use your personal compute resources. This action opens up a window where you can specify the fine-tuning settings.
40
43
41
-
2. Choose the "Model Card" option from the left menu for any foundation model, and then click the 'Fine-tune' button on the model card.
42
-
Select the suitable Service method to fine-tune your model. You can choose between 'Hosted fine-tuning' or 'User-managed compute'. If you intend to use your own compute resources, select the 'User-managed compute' option. To learn more about Fine-tuning using Serverless API, refer to the related content articles.
44
+
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-options.png" alt-text="Screenshot showing fine-tuning options for a foundation model in AI Studio." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-options.png":::
43
45
46
+
### Configure fine-tune settings
44
47
45
-
> [!NOTE]
46
-
> Some foundation models support only the 'User-managed compute' option.
48
+
In this section, you go through the steps to configure fine-tuning for your model, using a managed compute.
47
49
48
-

50
+
#### Basic settings
49
51
50
-
### Fine-tune Settings:
51
-
52
-
#### Basic Settings
53
-
54
-
- In the basic settings, provide a name for the fine-tuned model.
52
+
1. Provide a name for the fine-tuned model on the "Basic settings" page.
55
53
56
54
#### Compute
57
55
58
-
- Provide the Azure Machine Learning Compute cluster you would like to use for fine-tuning the model. Fine-tuning needs to run on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you wish to use.
59
-
60
-

56
+
1. Provide the Azure Machine Learning compute cluster to use for fine-tuning the model. Fine-tuning runs on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you plan to use.
61
57
62
-
#### Training Data
58
+
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png" alt-text="Screenshot showing settings for the compute to use for fine-tuning." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png":::
63
59
64
-
1. Pass in the training data you would like to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your workspace.
60
+
#### Training data
65
61
66
-
2. Once you've selected the dataset, you need to map the columns from your input data, based on the schema needed for the task. For example: map the column names that correspond to the 'sentence' and 'label' keys for Text Classification.
62
+
1. Provide the training data to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your workspace.
67
63
68
-

64
+
1. Map the columns from your input data, based on the schema needed for the task. For example, map the column names that correspond to the _sentence_ and _label_ keys for text classification.
69
65
66
+
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-training-data.png" alt-text="Screenshot showing settings for the training data to use for fine-tuning." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-training-data.png":::
70
67
71
68
#### Validation data
72
69
73
-
- Pass in the data you would like to use to validate your model. Selecting Automatic split reserves an automatic split of training data for validation. Alternatively, you can provide a different validation dataset.
70
+
1. Provide the data to use to validate your model. Selecting __Automatic split__ reserves an automatic split of training data for validation. Alternatively, you can provide a different validation dataset.
74
71
75
-
#### Test Parameters
72
+
#### Task parameters
76
73
77
-
- Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate.
74
+
1. Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate.
78
75
79
-
#### Review
76
+
#### Review
80
77
81
-
- Select Finish in the fine-tune form to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing.
78
+
1. Select __Finish__ in the fine-tune form to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing.
82
79
83
80
## Related Contents
84
81
-[Fine-tuning in Azure AI Studio - Azure AI Studio | Microsoft Learn](../concepts/fine-tuning-overview.md)
0 commit comments