Skip to content

Commit e182e51

Browse files
committed
PM guidance
1 parent 8d626b5 commit e182e51

File tree

1 file changed

+3
-62
lines changed

1 file changed

+3
-62
lines changed

articles/ai-studio/how-to/fine-tune-model-llama.md

Lines changed: 3 additions & 62 deletions
Original file line numberDiff line numberDiff line change
@@ -28,12 +28,7 @@ The [Meta Llama family of large language models (LLMs)](./deploy-models-llama.md
2828
## Models
2929
# [Meta Llama 3](#tab/llama-three)
3030

31-
The following models are available in Azure Marketplace for Llama 3 when fine-tuning as a service with pay-as-you-go billing:
32-
33-
- `Llama-3-80B-chat` (preview)
34-
- `LLama-3-8b-chat` (preview)
35-
36-
Fine-tuning of Llama 3 models is currently supported in projects located in West US 3.
31+
Fine-tuning of Llama 3 models is currently not supported.
3732

3833
# [Meta Llama 2](#tab/llama-two)
3934

@@ -51,32 +46,7 @@ Fine-tuning of Llama 2 models is currently supported in projects located in West
5146

5247
# [Meta Llama 3](#tab/llama-three)
5348

54-
An Azure subscription with a valid payment method. Free or trial Azure subscriptions won't work. If you don't have an Azure subscription, create a [paid Azure account](https://azure.microsoft.com/pricing/purchase-options/pay-as-you-go) to begin.
55-
- An [AI Studio hub](../how-to/create-azure-ai-resource.md).
56-
57-
> [!IMPORTANT]
58-
> For Meta Llama 3 models, the pay-as-you-go model fine-tune offering is only available with hubs created in **West US 3** regions.
59-
60-
- An [AI Studio project](../how-to/create-projects.md) in Azure AI Studio.
61-
- Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure AI Studio. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure subscription. Alternatively, your account can be assigned a custom role that has the following permissions:
62-
63-
- On the Azure subscription—to subscribe the AI Studio project to the Azure Marketplace offering, once for each project, per offering:
64-
- `Microsoft.MarketplaceOrdering/agreements/offers/plans/read`
65-
- `Microsoft.MarketplaceOrdering/agreements/offers/plans/sign/action`
66-
- `Microsoft.MarketplaceOrdering/offerTypes/publishers/offers/plans/agreements/read`
67-
- `Microsoft.Marketplace/offerTypes/publishers/offers/plans/agreements/read`
68-
- `Microsoft.SaaS/register/action`
69-
70-
- On the resource group—to create and use the SaaS resource:
71-
- `Microsoft.SaaS/resources/read`
72-
- `Microsoft.SaaS/resources/write`
73-
74-
- On the AI Studio project—to deploy endpoints (the Azure AI Developer role contains these permissions already):
75-
- `Microsoft.MachineLearningServices/workspaces/marketplaceModelSubscriptions/*`
76-
- `Microsoft.MachineLearningServices/workspaces/serverlessEndpoints/*`
77-
78-
For more information on permissions, see [Role-based access control in Azure AI Studio](../concepts/rbac-ai-studio.md).
79-
49+
Fine-tuning of Llama 3 models is currently not supported.
8050

8151
# [Meta Llama 2](#tab/llama-two)
8252

@@ -171,36 +141,7 @@ The supported file type is JSON Lines. Files are uploaded to the default datasto
171141

172142
# [Meta Llama 3](#tab/llama-three)
173143

174-
To fine-tune a LLama 3 model:
175-
176-
1. Sign in to [Azure AI Studio](https://ai.azure.com).
177-
1. Choose the model you want to fine-tune from the Azure AI Studio [model catalog](https://ai.azure.com/explore/models).
178-
179-
1. On the model's **Details** page, select **fine-tune**.
180-
181-
1. Select the project in which you want to fine-tune your models. To use the pay-as-you-go model fine-tune offering, your workspace must belong to the **West US 3** region.
182-
1. On the fine-tune wizard, select the link to **Azure Marketplace Terms** to learn more about the terms of use. You can also select the **Marketplace offer details** tab to learn about pricing for the selected model.
183-
1. If this is your first time fine-tuning the model in the project, you have to subscribe your project for the particular offering (for example, Meta-Llama-3-70B) from Azure Marketplace. This step requires that your account has the Azure subscription permissions and resource group permissions listed in the prerequisites. Each project has its own subscription to the particular Azure Marketplace offering, which allows you to control and monitor spending. Select **Subscribe and fine-tune**.
184-
185-
> [!NOTE]
186-
> Subscribing a project to a particular Azure Marketplace offering (in this case, Meta-Llama-3-70B) requires that your account has **Contributor** or **Owner** access at the subscription level where the project is created. Alternatively, your user account can be assigned a custom role that has the Azure subscription permissions and resource group permissions listed in the [prerequisites](#prerequisites).
187-
188-
1. Once you sign up the project for the particular Azure Marketplace offering, subsequent fine-tuning of the _same_ offering in the _same_ project don't require subscribing again. Therefore, you don't need to have the subscription-level permissions for subsequent fine-tune jobs. If this scenario applies to you, select **Continue to fine-tune**.
189-
190-
1. Enter a name for your fine-tuned model and the optional tags and description.
191-
1. Select training data to fine-tune your model. See [data preparation](#data-preparation) for more information.
192-
193-
Make sure all your training examples follow the expected format for inference. To fine-tune models effectively, ensure a balanced and diverse dataset. This involves maintaining data balance, including various scenarios, and periodically refining training data to align with real-world expectations, ultimately leading to more accurate and balanced model responses.
194-
- The batch size to use for training. When set to -1, batch_size is calculated as 0.2% of examples in training set and the max is 256.
195-
- The fine-tuning learning rate is the original learning rate used for pretraining multiplied by this multiplier. We recommend experimenting with values between 0.5 and 2. Empirically, we've found that larger learning rates often perform better with larger batch sizes. Must be between 0.0 and 5.0.
196-
- Number of training epochs. An epoch refers to one full cycle through the data set.
197-
198-
1. Task parameters are an optional step and an advanced option- Tuning hyperparameter is essential for optimizing large language models (LLMs) in real-world applications. It allows for improved performance and efficient resource usage. The default settings can be used or advanced users can customize parameters like epochs or learning rate.
199-
200-
1. Review your selections and proceed to train your model.
201-
202-
Once your model is fine-tuned, you can deploy the model and can use it in your own application, in the playground, or in prompt flow. For more information, see [How to deploy Llama 3 family of large language models with Azure AI Studio](./deploy-models-llama.md).
203-
144+
Fine-tuning of Llama 3 models is currently not supported.
204145

205146
# [Meta Llama 2](#tab/llama-two)
206147

0 commit comments

Comments
 (0)