Skip to content

Commit b5cbd0a

Browse files
committed
update fine-tune steps and screenshots
1 parent a7f160a commit b5cbd0a

File tree

6 files changed

+46
-42
lines changed

6 files changed

+46
-42
lines changed

articles/ai-studio/concepts/fine-tuning-overview.md

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ Consider fine-tuning GenAI models to:
2727
- Save time and resources with faster and more precise results
2828
- Get more relevant and context-aware outcomes as models are fine-tuned for specific use cases
2929

30-
[Azure AI Foundry](https://ai.azure.com) offers several models across model providers enabling you to get access to the latest and greatest in the market. You can discover supported models for fine-tuning through our model catalog by using the **Fine-tuning tasks** filter and clicking into the model card to learn detailed information about each model. Specific models may be subjected to regional constraints, [view this list for more details](#supported-models-for-fine-tuning).
30+
[Azure AI Foundry](https://ai.azure.com) offers several models across model providers enabling you to get access to the latest and greatest in the market. You can discover supported models for fine-tuning through our model catalog by using the **Fine-tuning tasks** filter and selecting the model card to learn detailed information about each model. Specific models may be subjected to regional constraints, [view this list for more details](#supported-models-for-fine-tuning).
3131

3232
:::image type="content" source="../media/concepts/model-catalog-fine-tuning.png" alt-text="Screenshot of Azure AI Foundry model catalog and filtering by Fine-tuning tasks." lightbox="../media/concepts/model-catalog-fine-tuning.png":::
3333

@@ -78,7 +78,12 @@ It's important to call out that fine-tuning is heavily dependent on the quality
7878

7979
## Supported models for fine-tuning
8080

81-
Now that you know when to use fine-tuning for your use case, you can go to Azure AI Foundry to find models available to fine-tune. Fine-tuning is available in specific Azure regions for some models. To fine-tune such models, a user must have a hub/project in the region where the model is available for fine-tuning. See [Region availability for models in serverless API endpoints | Azure AI Foundry](../how-to/deploy-models-serverless-availability.md) for detailed information.
81+
Now that you know when to use fine-tuning for your use case, you can go to Azure AI Foundry to find models available to fine-tune.
82+
For some models in the model catalog, fine-tuning is available by using a serverless API, or a managed compute (preview), or both.
83+
84+
Fine-tuning is available in specific Azure regions for some models that are deployed via serverless APIs. To fine-tune such models, a user must have a hub/project in the region where the model is available for fine-tuning. See [Region availability for models in serverless API endpoints](../how-to/deploy-models-serverless-availability.md) for detailed information.
85+
86+
For more information on fine-tuning using a managed compute (preview), see [Fine-tune models using managed compute (preview)](../how-to/fine-tune-managed-compute.md).
8287

8388
For details about Azure OpenAI models that are available for fine-tuning, see the [Azure OpenAI Service models documentation](../../ai-services/openai/concepts/models.md#fine-tuning-models) or the [Azure OpenAI models table](#fine-tuning-azure-openai-models) later in this guide.
8489

@@ -91,7 +96,7 @@ For the Azure OpenAI Service models that you can fine tune, supported regions f
9196

9297
## Related content
9398

94-
- [Fine-tune a model using User-managed compute](../how-to/fine-tune-maap.md)
99+
- [Fine-tune a model using managed compute (preview)](../how-to/fine-tune-maap.md)
95100
- [Fine-tune an Azure OpenAI model in Azure AI Foundry portal](../../ai-services/openai/how-to/fine-tuning.md?context=/azure/ai-studio/context/context)
96101
- [Fine-tune a Llama 2 model in Azure AI Foundry portal](../how-to/fine-tune-model-llama.md)
97102
- [Fine-tune a Phi-3 model in Azure AI Foundry portal](../how-to/fine-tune-phi-3.md)
Lines changed: 37 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -1,82 +1,81 @@
11
---
2-
title: Fine-tune models using a user-managed compute with Azure AI Studio
3-
titleSuffix: Azure AI Studio
4-
description: Learn how to fine-tune models using a user-managed compute with Azure AI Studio.
2+
title: Fine-tune models using a managed compute with Azure AI Foundry portal (preview)
3+
titleSuffix: Azure AI Foundry
4+
description: Learn how to fine-tune models using a managed compute with Azure AI Foundry.
55
manager: scottpolly
66
ms.service: azure-ai-studio
77
ms.topic: how-to
8-
ms.date: 10/25/2024
8+
ms.date: 11/22/2024
99
ms.reviewer: vkann
1010
reviewer: kvijaykannan
1111
ms.author: mopeakande
1212
author: msakande
1313
ms.custom: references_regions
1414

15-
#customer intent: As a data scientist using a user-managed compute, I want to learn how to fine-tune models to improve model performance for specific tasks.
15+
#customer intent: As a data scientist using a managed compute, I want to learn how to fine-tune models to improve model performance for specific tasks.
1616
---
1717

18-
# Fine-tune models using user-managed compute
18+
# Fine-tune models using managed compute (preview)
1919

20-
This article explains how to use a user-managed compute to fine-tune a foundation model in Azure AI Studio. Fine-tuning involves adapting a pretrained model to a new, related task or domain. When you use a managed compute for fine-tuning, you use your computational resources to adjust training parameters such as learning rate, batch size, and number of training epochs to optimize the model's performance for a specific task. Fine-tuning a pretrained model to use for a related task is more efficient than building a new model, as it builds upon the pretrained model's existing knowledge and reduces the time and data needed for training.
20+
[!INCLUDE [feature-preview](../includes/feature-preview.md)]
2121

22-
To improve model performance, you might consider fine-tuning a foundation model with your training data. You can easily fine-tune foundation models by using either the fine-tune settings in AI Studio or by using code-based samples.
22+
This article explains how to use a managed compute to fine-tune a foundation model in the Azure AI Foundry portal. Fine-tuning involves adapting a pretrained model to a new, related task or domain. When you use a managed compute for fine-tuning, you use your computational resources to adjust training parameters such as learning rate, batch size, and number of training epochs to optimize the model's performance for a specific task.
23+
24+
Fine-tuning a pretrained model to use for a related task is more efficient than building a new model, as fine-tuning builds upon the pretrained model's existing knowledge and reduces the time and data needed for training.
25+
26+
To improve model performance, you might consider fine-tuning a foundation model with your training data. You can easily fine-tune foundation models by using either the fine-tune settings in Azure AI Foundry portal or by using code-based samples.
2327

2428
__Todo: link to the code-based samples__
2529

2630
## Prerequisites
2731

2832
- An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
2933

30-
- An [Azure AI Studio hub](create-azure-ai-resource.md).
31-
32-
- An [Azure AI Studio project](create-projects.md).
34+
- An [Azure AI Foundry project](create-projects.md).
3335

34-
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. For more information on permissions, see [Role-based access control in Azure AI Studio](../concepts/rbac-ai-studio.md).
36+
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Foundry portal. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. For more information on permissions, see [Role-based access control in Azure AI Foundry portal](../concepts/rbac-ai-studio.md).
3537

3638
## Fine-tune a foundation model using managed compute
3739

38-
1. Sign in to [Azure AI Studio](https://ai.azure.com).
39-
1. Select **Fine-tuning** from the left sidebar and add the foundation model that you want to finetune.
40-
1. Alternatively, you could select **Model catalog** from the left sidebar and find the model card of the foundation model that you want to finetune.
41-
1. Select __Fine-tune__ on the model card to see the available fine-tune options. Some foundation models support only the __User-managed compute__ option.
42-
1. Select the __User-managed compute__ option to use your personal compute resources. This action opens up a window where you can specify the fine-tuning settings.
40+
1. Sign in to [Azure AI Foundry](https://ai.azure.com).
4341

44-
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-options.png" alt-text="Screenshot showing fine-tuning options for a foundation model in AI Studio." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-options.png":::
42+
1. If you're not already in your project, select it.
43+
1. Select **Fine-tuning** from the left navigation pane.
4544

46-
### Configure fine-tune settings
47-
48-
In this section, you go through the steps to configure fine-tuning for your model, using a managed compute.
45+
1. Select **Fine-tune model** and add the model that you want to fine-tune. This article uses _Phi-3-mini-4k-instruct_ for illustration.
46+
1. Select **Next** to see the available fine-tune options. Some foundation models support only the __Managed compute__ option.
4947

50-
#### Basic settings
48+
1. Alternatively, you could select **Model catalog** from the left sidebar of your project and find the model card of the foundation model that you want to fine-tune.
5149

52-
1. Provide a name for the fine-tuned model on the "Basic settings" page.
50+
1. Select __Fine-tune__ on the model card to see the available fine-tune options. Some foundation models support only the __Managed compute__ option.
5351

54-
#### Compute
52+
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-options.png" alt-text="Screenshot showing fine-tuning options for a foundation model in Azure AI Foundry." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-options.png":::
5553

56-
1. Provide the Azure Machine Learning compute cluster to use for fine-tuning the model. Fine-tuning runs on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you plan to use.
54+
1. Select __Managed compute__ to use your personal compute resources. This action opens up the "Basic settings" page of a window for specifying the fine-tuning settings.
5755

58-
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png" alt-text="Screenshot showing settings for the compute to use for fine-tuning." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png":::
56+
### Configure fine-tune settings
5957

60-
#### Training data
58+
In this section, you go through the steps to configure fine-tuning for your model, using a managed compute.
6159

62-
1. Provide the training data to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your workspace.
60+
1. Provide a name for the fine-tuned model on the "Basic settings" page, and select **Next** to go to the "Compute" page.
6361

64-
1. Map the columns from your input data, based on the schema needed for the task. For example, map the column names that correspond to the _sentence_ and _label_ keys for text classification.
62+
1. Select the Azure Machine Learning compute cluster to use for fine-tuning the model. Fine-tuning runs on GPU compute. Ensure that you have sufficient compute quota for the compute SKUs you plan to use.
6563

66-
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-training-data.png" alt-text="Screenshot showing settings for the training data to use for fine-tuning." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-training-data.png":::
64+
:::image type="content" source="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png" alt-text="Screenshot showing settings for the compute to use for fine-tuning." lightbox="../media/how-to/fine-tune-managed-compute/fine-tune-compute.png":::
6765

68-
#### Validation data
66+
1. Select **Next** to go to the "Training data" page. On this page, the "Task type" is preselected as **Chat completion**.
6967

70-
1. Provide the data to use to validate your model. Selecting __Automatic split__ reserves an automatic split of training data for validation. Alternatively, you can provide a different validation dataset.
68+
1. Provide the training data to use to fine-tune your model. You can choose to either upload a local file (in JSONL, CSV or TSV format) or select an existing registered dataset from your project.
7169

72-
#### Task parameters
70+
1. Select **Next** to go to the "Validation data" page. Keep the **Automatic split of training data** selection to reserve an automatic split of training data for validation. Alternatively, you could provide a different validation dataset by uploading a local file (in JSONL, CSV or TSV format) or selecting an existing registered dataset from your project.
7371

74-
1. Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate.
72+
1. Select **Next** to go to the "Task parameters" page. Tuning hyperparameters is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. You can choose to keep the default settings or customize parameters like epochs or learning rate.
7573

76-
#### Review
74+
1. Select **Next** to go to the "Review" page and check that all the settings look good.
7775

78-
1. Select __Finish__ in the fine-tune form to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing.
76+
1. Select **Submit** to submit your fine-tuning job. Once the job completes, you can view evaluation metrics for the fine-tuned model. You can then deploy this model to an endpoint for inferencing.
7977

8078
## Related Contents
81-
- [Fine-tuning in Azure AI Studio - Azure AI Studio | Microsoft Learn](../concepts/fine-tuning-overview.md)
82-
- [Deploy Phi-3 family of small language models with Azure AI Studio](../how-to/deploy-models-phi-3.md)
79+
80+
- [Fine-tune models with Azure AI Foundry](../concepts/fine-tuning-overview.md)
81+
- [How to use Phi-3 family chat models](deploy-models-phi-3.md)

articles/ai-studio/how-to/model-catalog-overview.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -149,7 +149,7 @@ Models from Microsoft are billed via Azure meters as First Party Consumption Ser
149149

150150
### Fine-tuning models
151151

152-
Certain models support also fine-tuning. For these models, you can take advantage of user-managed compute or pay-as-you-go fine-tuning to tailor the models by using data that you provide. For more information, see the [fine-tuning overview](../concepts/fine-tuning-overview.md).
152+
Certain models also support fine-tuning. For these models, you can take advantage of managed compute (preview) or serverless API fine-tuning to tailor the models by using data that you provide. For more information, see the [fine-tuning overview](../concepts/fine-tuning-overview.md).
153153

154154
### RAG with models deployed as serverless APIs
155155

-83.7 KB
Loading
-86 KB
Loading

0 commit comments

Comments
 (0)