|
| 1 | +--- |
| 2 | +title: Fine-tune models using User-managed compute |
| 3 | +titleSuffix: Azure AI Studio |
| 4 | +description: Learn how to do fine-tune models using User-managed compute. |
| 5 | +manager: scottpolly |
| 6 | +ms.service: azure-ai-studio |
| 7 | +ms.topic: how-to |
| 8 | +ms.date: 10/02/2024 |
| 9 | +ms.reviewer: vkann |
| 10 | +reviewer: kvijaykannan |
| 11 | +ms.author: mopeakande |
| 12 | +author: msakande |
| 13 | +ms.custom: references_regions |
| 14 | + |
| 15 | +#customer intent: As a Data Scientist, I want to learn how to fine-tune models using user managed compute <what> so that <why> |
| 16 | +--- |
| 17 | + |
| 18 | +# Fine-tune using User-managed compute |
| 19 | + |
| 20 | +In this article |
| 21 | + - [Fine-tune using User-managed compute](#distillation) |
| 22 | + - [Related Contents](#next-steps) |
| 23 | + |
| 24 | + |
| 25 | +## How to fine-tune foundation models using your own training data |
| 26 | + |
| 27 | +In order to improve model performance in your workload, you might want to fine tune a foundation model using your own training data. You can easily fine-tune these foundation models by using either the fine-tune settings in the studio or by using the code based samples. |
| 28 | + |
| 29 | +## Fine-tune using the User-managed compute |
| 30 | + |
| 31 | +You can access the fine-tune settings form using one of the following methods: |
| 32 | +1. Choose the "Fine-Tuning" option from the left menu, and then select any foundation model. |
| 33 | + |
| 34 | +2. Choose the "Model Card" option from the left menu for any foundation model, and then click the ‘Fine-tune’ button on the model card. |
| 35 | +Select the suitable Service method to fine-tune your model. You can choose between 'Hosted fine-tuning' or 'User-managed compute'. If you intend to use your own compute resources, select the 'User-managed compute' option. To learn more about Fine-tuning using Serverless API, refer to the related content articles. |
| 36 | + |
| 37 | + |
| 38 | + > [!NOTE] |
| 39 | + > Some foundation models support only the 'User-managed compute' option. |
| 40 | +
|
| 41 | + |
| 42 | + |
| 43 | +### Fine-tune Settings: |
| 44 | + |
| 45 | +#### Basic Settings |
| 46 | + |
| 47 | +- In the basic settings, provide a name for the fine-tuned model. |
| 48 | + |
| 49 | +#### Compute |
| 50 | + |
| 51 | +- Provide the Azure Machine Learning Compute cluster you would like to use for fine-tuning the model. Fine-tuning needs to run on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you wish to use. |
| 52 | + |
| 53 | + |
| 54 | + |
| 55 | +#### Training Data |
| 56 | + |
| 57 | +1. Pass in the training data you would like to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your workspace. |
| 58 | + |
| 59 | +2. Once you've selected the dataset, you need to map the columns from your input data, based on the schema needed for the task. For example: map the column names that correspond to the 'sentence' and 'label' keys for Text Classification. |
| 60 | + |
| 61 | + |
| 62 | + |
| 63 | + |
| 64 | +#### Validation data |
| 65 | + |
| 66 | +- Pass in the data you would like to use to validate your model. Selecting Automatic split reserves an automatic split of training data for validation. Alternatively, you can provide a different validation dataset. |
| 67 | + |
| 68 | +#### Test Parameters |
| 69 | + |
| 70 | +- Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate. |
| 71 | + |
| 72 | +#### Review |
| 73 | + |
| 74 | +- Select Finish in the fine-tune form to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing. |
| 75 | + |
| 76 | +## Related Contents |
| 77 | +- [Fine-tuning in Azure AI Studio - Azure AI Studio | Microsoft Learn](../fine-tuning-overview.md) |
| 78 | +- [Fine-tune a Llama 2 model in Azure AI Studio](../fine-tune-model-llama.md) |
| 79 | +- [Fine-tune a Phi-3 model in Azure AI Studio](../fine-tune-phi-3.md) |
| 80 | +- [Deploy Phi-3 family of small language models with Azure AI Studio](../deploy-models-phi-3.md) |
0 commit comments