Skip to content

Commit 21a95c5

Browse files
Merge pull request #6270 from MicrosoftDocs/main
Auto Publish – main to live - 2025-07-29 11:00 UTC
2 parents 80b2481 + 9f4735e commit 21a95c5

File tree

6 files changed

+181
-44
lines changed

6 files changed

+181
-44
lines changed

articles/ai-foundry/how-to/evaluation-azure-devops.md

Lines changed: 49 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: How to run evaluation in Azure DevOps which enables offline evaluat
55
manager: scottpolly
66
ms.service: azure-ai-foundry
77
ms.topic: how-to
8-
ms.date: 05/19/2025
8+
ms.date: 07/25/2025
99
ms.reviewer: hanch
1010
ms.author: lagayhar
1111
author: lgayhardt
@@ -21,8 +21,7 @@ Similar to the [Azure AI evaluation in GitHub Actions](evaluation-github-action.
2121

2222
## Prerequisites
2323

24-
[!INCLUDE [hub-only-prereq](../includes/hub-only-prereq.md)]
25-
24+
- Foundry project or Hubs based project. To learn more, see [Create a project](create-projects.md).
2625
- Install Azure AI evaluation extension.
2726
- Go to [Azure DevOps Marketplace](https://marketplace.visualstudio.com/azuredevops).
2827
- Search for Azure AI evaluation and install the extension into your Azure DevOps organization.
@@ -65,7 +64,51 @@ Similar to the [Azure AI evaluation in GitHub Actions](evaluation-github-action.
6564

6665
A sample YAML file:
6766

68-
```yml
67+
# [Foundry project](#tab/foundry-project)
68+
69+
```yaml
70+
71+
trigger:
72+
- main
73+
pool:
74+
75+
  vmImage: 'windows-latest' 
76+
77+
steps:
78+
79+
- task: AzureCLI@2
80+
  inputs:
81+
    addSpnToEnvironment: true
82+
    azureSubscription: ${{vars.Service_Connection_Name}}
83+
    scriptType: bash
84+
    scriptLocation: inlineScript    
85+
86+
    inlineScript: |
87+
      echo "##vso[task.setvariable variable=ARM_CLIENT_ID]$servicePrincipalId" 
88+
      echo "##vso[task.setvariable variable=ARM_ID_TOEKN]$idToken"
89+
      echo "##vso[task.setvariable variable=ARM_TENANT_ID]$tenantId"
90+
91+
- bash: |
92+
93+
   az login --service-principal -u $(ARM_CLIENT_ID) --tenant $(ARM_TENANT_ID) --allow-no-subscriptions --federated-token $(ARM_ID_TOEKN)
94+
95+
  displayName: 'Login Azure'
96+
97+
- task: UsePythonVersion@0
98+
  inputs:
99+
    versionSpec: '3.11'
100+
- task: AIAgentEvaluation@0
101+
  inputs:
102+
    azure-ai-project-endpoint: "<your-ai-project-endpoint>"
103+
    deployment-name: "gpt-4o-mini"
104+
    data-path: $(Build.SourcesDirectory)\tests\data\golden-dataset-medium.json
105+
agent-ids: "<your-ai-agent-ids>
106+
107+
```
108+
109+
# [Hub based project](#tab/hub-project)
110+
111+
```yaml
69112

70113
trigger:
71114
- main
@@ -105,6 +148,8 @@ agent-ids: "<your-ai-agent-ids>
105148

106149
```
107150

151+
---
152+
108153
## Set up a new pipeline and trigger an evaluation run
109154

110155
Commit and run the pipeline in Azure DevOps.

articles/ai-services/language-service/conversational-language-understanding/how-to/configure-azure-resources.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,25 @@ Azure AI Foundry offers a unified platform where you can easily build, manage, a
118118

119119
:::image type="content" source="../media/configure-resources/connect-language-resource.png" alt-text="Screenshot of connect search resource selector in the Azure AI Foundry.":::
120120

121-
1. Your resources are now set up properly. Continue with setting up the fine-tuning task and customizing your CLU project.
121+
## Import an existing Azure AI project
122+
123+
Azure AI Foundry allows you to connect to your existing Azure AI services resources. This means you can establish a connection within your Azure AI Foundry project to the Azure AI Language resource where your custom models are stored.
124+
125+
To import an existing Azure AI services project with Azure AI Foundry, you need to create a connection to the Azure AI services resource within your Azure AI Foundry project. For more information, *see* [Connect Azure AI Services projects to Azure AI Foundry](../../../../ai-services/connect-services-ai-foundry-portal.md)
126+
127+
## Export a project
128+
129+
You can download a CLU project as a **config.json** file:
130+
131+
1. Navigate to your project home page.
132+
1. At the top of the page, select your project from the right page ribbon area.
133+
1. Select **Download config file**.
134+
135+
:::image type="content" source="../media/create-project/download-config-json.png" alt-text="Screenshot of project drop-down menu with the download config file hyperlink in the Azure AI Foundry.":::
136+
137+
138+
139+
That's it! Your resources are now set up properly. Continue with setting up the fine-tuning task and customizing your CLU project.
122140

123141
## Next Steps
124142

Lines changed: 108 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
2-
title: Create Projects in Conversational Language Understanding
2+
title: Create a CLU fine-tuning task in Azure AI Foundry or with the REST API
33
titleSuffix: Azure AI services
4-
description: This article shows you how to create projects in conversational language understanding (CLU).
4+
description: This article shows you how to create CLU fine-tuning task projects the Azure AI Foundry or using the REST API.
55
author: laujan
66
manager: nitinme
77
ms.service: azure-ai-language
@@ -11,73 +11,100 @@ ms.author: lajanuar
1111
ms.custom: language-service-clu
1212
---
1313

14-
# Create a CLU project in Azure AI Foundry
14+
# Create a fine-tuning task project
1515

16-
Azure AI Foundry projects help you organize your work when exploring new ideas or developing prototypes for specific use cases. A Foundry project is created on an Azure AI Foundry resource. This type of project offers an easy setup and provides access to agents and Azure AI models.
16+
A Conversational Language Understanding (CLU) fine-tuning task is a workspace project where you customize a language model to identify user intent and extract key information (entities) from user input (utterances). In this workspace, you define the intents and entities relevant to your application, label sample user utterances accordingly, and use this labeled data to fine-tune the model. This process tailors the model to better understand the specific needs and nuances of your conversational application. In this guide, we walk you through configuring a fine-tuning workspace in the Azure AI Foundry or using the REST API.
1717

18-
If you already have an Azure AI Language or multi-service resource—whether used on its own or through Language Studio—you can continue to use those existing Language resources within the Azure AI Foundry portal. For more information, see [How to use Azure AI services in the Azure AI Foundry portal](../../../../ai-services/connect-services-ai-foundry-portal.md).
18+
> [!NOTE]
19+
>
20+
> If you already have an Azure AI Language or multi-service resource—whether used on its own or through Language Studio—you can continue to use those existing Language resources within the Azure AI Foundry portal. For more information, see [How to use Azure AI services in the Azure AI Foundry portal](../../../../ai-services/connect-services-ai-foundry-portal.md).
21+
>
22+
> In Azure AI Foundry, you set up a fine-tuning task to serve as your workspace when customizing your CLU model. Previously, a **fine-tuning task** was referred to as a **CLU project**. You might encounter both terms used interchangeably in older CLU documentation.
23+
>
1924
2025
## Prerequisites
2126

2227
* An Azure subscription. If you don't have one, you can [create one for free](https://azure.microsoft.com/free/cognitive-services).
2328
* **Requisite permissions**. Make sure the person establishing the account and project is assigned as the Azure AI Account Owner role at the subscription level. Alternatively, having either the **Contributor** or **Cognitive Services Contributor** role at the subscription scope also meets this requirement. For more information, *see* [Role based access control (RBAC)](../../../openai/how-to/role-based-access-control.md#cognitive-services-contributor).
24-
* An [Azure AI Foundry resource](../../../multi-service-resource.md)
25-
* For more information, *see* [Configure an Azure AI Foundry resource](configure-azure-resources.md#option-1-configure-an-azure-ai-foundry-resource).
26-
* After you create an Azure AI Foundry resource, [create a CLU project](#create-a-clu-project).
29+
* An [Azure AI Foundry multi-service resource](../../../multi-service-resource.md). For more information, *see* [Configure an Azure AI Foundry resource](configure-azure-resources.md#option-1-configure-an-azure-ai-foundry-resource). Alternately, you can use an [Azure AI Language resource](https://portal.azure.com/?Microsoft_Azure_PIMCommon=true#create/Microsoft.CognitiveServicesTextAnalytics).
30+
* A Foundry project created in the Azure AI Foundry. For more information, *see* [Create an AI Foundry project](../../../../ai-foundry/how-to/create-projects.md).
2731

28-
## Create a CLU project
32+
> [!NOTE]
33+
>
34+
> We highly recommend that you use an Azure AI Foundry resource in the AI Foundry; however, you can also follow these instructions using a Language resource.
2935
30-
An Azure AI Foundry project is created using an Azure AI Foundry resource. Projects are designed to help you organize your work. They offer various tools and resources that support the development, customization, and management of AI applications all within a centralized environment.
36+
## Create a CLU fine-tuning task project
37+
38+
To create a CLU fine-tuning task project, you first configure your environment and then create a fine-tuning task, which serves as your workspace for customizing your CLU model.
3139

3240
### [Azure AI Foundry](#tab/azure-ai-foundry)
3341

34-
To learn how to create a CLU Foundry project, *see* [Create an AI Foundry project](../../../../ai-foundry/how-to/create-projects.md).
42+
1. Navigate to the [Azure AI Foundry](https://ai.azure.com/).
43+
1. If you aren't already signed in, the portal prompts you to do so with your Azure credentials.
44+
1. Once signed in, you can create or access your existing projects within Azure AI Foundry.
45+
1. If you're not already at your project for this task, select it.
46+
1. Select Fine-tuning from the left navigation panel.
3547

48+
:::image type="content" source="../media/select-fine-tuning.png" alt-text="Screenshot of fine-tuning selector in the Azure AI Foundry.":::
3649

37-
### [REST APIs](#tab/rest-api)
50+
1. Select **the AI Service fine-tuning** tab and then **+ Fine-tune** button.
3851

39-
[!INCLUDE [create project](../includes/rest-api/create-project.md)]
52+
:::image type="content" source="../media/fine-tune-button.png" alt-text="Screenshot of fine-tuning button in the Azure AI Foundry.":::
4053

41-
---
54+
1. From **Create service fine-tuning** window, choose the **Conversational language understanding** tab then select **Next**.
4255

43-
## Import an existing Azure AI project
56+
:::image type="content" source="../media/select-project.png" alt-text="Screenshot of conversational language understanding tab in the Azure AI Foundry.":::
4457

45-
### [Azure AI Foundry](#tab/azure-ai-foundry)
58+
1. In **Create CLU fine-tuning task** window, complete the **Name** and **Language** fields. If you're planning to fine-tune a model using the free **Standard Training** mode, select **English** for the language field.
4659

47-
To import an existing Azure AI services project with Azure AI Foundry, you need to create a connection to the Azure AI services resource within your Azure AI Foundry project. For more information, *see* [Connect Azure AI Services projects to Azure AI Foundry](../../../../ai-services/connect-services-ai-foundry-portal.md)
60+
1. Navigate to the [Azure AI Foundry](https://ai.azure.com/).
61+
1. If you aren't already signed in, the portal prompts you to do so with your Azure credentials.
62+
1. Once signed in, you can create or access your existing projects within Azure AI Foundry.
63+
1. If you're not already at your project for this task, select it.
64+
1. Select Fine-tuning from the left navigation panel.
4865

49-
### [REST APIs](#tab/rest-api)
66+
:::image type="content" source="../media/select-fine-tuning.png" alt-text="Screenshot of fine-tuning selector in the Azure AI Foundry.":::
5067

51-
You can import a CLU JSON into the service.
68+
1. Select **the AI Service fine-tuning** tab and then **+ Fine-tune** button.
5269

53-
[!INCLUDE [Import project](../includes/rest-api/import-project.md)]
70+
:::image type="content" source="../media/fine-tune-button.png" alt-text="Screenshot of fine-tuning button in the Azure AI Foundry.":::
5471

55-
---
72+
1. From **Create service fine-tuning** window, choose the **Conversational language understanding** tab then select **Next**.
5673

57-
## Export a project
74+
:::image type="content" source="../media/select-project.png" alt-text="Screenshot of conversational language understanding tab in the Azure AI Foundry.":::
5875

59-
### [Azure AI Foundry](#tab/azure-ai-foundry)
76+
1. In **Create CLU fine tuning task** window, select your **Connected service** from the drop-down menu, then complete the **Name** and **Language** fields. If you're using the free **Standard Training** mode, select **English** for the language field.
6077

61-
You can download a CLU project as a **config.json** file:
78+
1. Select the **Create** button. It can take a few minutes for the *creating* operation to complete.
6279

63-
1. Navigate to your project home page.
64-
1. At the top of the page, select your project from the right page ribbon area.
65-
1. Select **Download config file**.
6680

67-
:::image type="content" source="../media/create-project/download-config-json.png" alt-text="Screenshot of project drop-down menu with the download config file hyperlink in the Azure AI Foundry.":::
81+
> [!NOTE]
82+
>
83+
> * **Standard training** enables faster training times and quicker iterations; however it's only available for English.
84+
> * **Advanced training** includes longer training durations and is supported for English, other languages, and multilingual projects.
85+
> * For more information, *see* [Training modes](train-model.md#training-modes).
6886
69-
### [REST APIs](#tab/rest-api)
87+
1. Once the task creation is complete, select the task from the AI Service fine-tuning window to arrive at the Getting started with fine-tuning page.
7088

71-
You can export a CLU project as a JSON file at any time.
89+
:::image type="content" source="../media/create-project/getting-started-fine-tuning.png" alt-text="Screenshot of the getting started with fine-tuning page in the Azure AI Foundry." lightbox="../media/create-project/getting-started-fine-tuning.png":::
7290

73-
[!INCLUDE [Export project](../includes/rest-api/export-project.md)]
91+
### [REST APIs](#tab/rest-api)
92+
93+
[!INCLUDE [create project](../includes/rest-api/create-project.md)]
7494

7595
---
7696

97+
98+
That's it! You can get started on your fine-tuning task project. For more information, *see* [Next steps](#next-steps).
99+
77100
## View and manage project details
78101

102+
You can retrieve up-to-date information about your projects, make any necessary changes, and oversee project management tasks efficiently through the Azure AI Foundry or REST API endpoints.
103+
79104
### [Azure AI Foundry](#tab/azure-ai-foundry)
80105

106+
Your Azure AI Foundry project overview page displays information about your fine-tuning task project, including its name, subscription, resource group, and connected resources. You can also access the project's resources in the Azure portal by selecting **Manage in Azure portal** on the overview page.
107+
81108
* On the project Home page, information about the project is found in the **Project details** section.
82109
* To view project settings, select **Management center** from the bottom of the left navigation pane, then select one of the following tabs:
83110
* **Overview** to view project details.
@@ -89,14 +116,56 @@ You can export a CLU project as a JSON file at any time.
89116

90117
### [REST APIs](#tab/rest-api)
91118

119+
You can access, view, and manage all of your project details via the REST API.
120+
92121
[!INCLUDE [REST APIs project details](../includes/rest-api/project-details.md)]
93122

94123
---
95124

96-
## Delete a project
125+
## Import an existing Azure AI project
126+
127+
Importing the configuration file allows you to bring your existing settings directly into the platform, making it easier to set up and customize your service based on your predefined preferences.
97128

98129
### [Azure AI Foundry](#tab/azure-ai-foundry)
99130

131+
To import an existing Azure AI services project with Azure AI Foundry, you need to create a connection to the Azure AI services resource within your Azure AI Foundry project. For more information, *see* [Connect Azure AI Services projects to Azure AI Foundry](../../../../ai-services/connect-services-ai-foundry-portal.md)
132+
133+
### [REST APIs](#tab/rest-api)
134+
135+
You can import your CLU config.json file using the REST API
136+
137+
[!INCLUDE [Import project](../includes/rest-api/import-project.md)]
138+
139+
---
140+
141+
## Export a fine-tuning project
142+
143+
Exporting your configuration file enables you to save the current state of your project's settings and structure, making it easy to back up or transfer your project as needed.
144+
145+
### [Azure AI Foundry](#tab/azure-ai-foundry)
146+
147+
You can download an Azure Foundry fine fine-tuning task project as a **config.json** file:
148+
149+
1. Navigate to your project home page.
150+
1. At the top of the page, select your project from the right page ribbon area.
151+
1. Select **Download config file**.
152+
153+
:::image type="content" source="../media/create-project/download-config-json.png" alt-text="Screenshot of project drop-down menu with the download config file hyperlink in the Azure AI Foundry.":::
154+
155+
### [REST APIs](#tab/rest-api)
156+
157+
You can export a CLU project as a config.json file.
158+
159+
[!INCLUDE [Export project](../includes/rest-api/export-project.md)]
160+
161+
---
162+
163+
164+
## Delete a project
165+
166+
Deleting a project ensures that it and all of its associated data are permanently removed from the system.
167+
168+
### [Azure AI Foundry](#tab/azure-ai-foundry)
100169

101170
If you no longer need your project, you can delete it from the Azure AI Foundry.
102171

@@ -113,19 +182,22 @@ To delete the hub along with all its projects:
113182

114183
:::image type="content" source="../media/create-project/hub-details.png" alt-text="Screenshot of the hub details list in the Azure AI Foundry.":::
115184

116-
1. On the right, select **Delete hub**.
185+
1. On the right, select **Delete hub**.
117186
1. The link opens the Azure portal for you to delete the hub there.
118187

119188
:::image type="content" source="../media/create-project/delete-hub.png" alt-text="Screenshot of the Delete hub button in the Azure AI Foundry.":::
120189

121190
### [REST APIs](#tab/rest-api)
122191

123-
If you no longer need your project, delete it using the REST API.
192+
If your project is no longer required, you can delete it using the REST API. To proceed, access the REST API and follow the documented steps for project deletion to complete this action.
124193

125194
[!INCLUDE [Delete project](../includes/rest-api/delete-project.md)]
126195

127196
---
128197

129-
## Related content
198+
## Next steps
199+
200+
After you create your fine-tuning workspace, start your fine-tuning task by defining your intents and entities and adding them to your schema:
130201

131-
- [Build schema](./build-schema.md)
202+
* [Build your fine-tuning schema](build-schema.md)
203+
* [Label utterances](tag-utterances.md)

articles/ai-services/language-service/conversational-language-understanding/how-to/train-model.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,9 @@ Use the evaluation scores to guide your decisions. There may be times where a sp
103103

104104
:::image type="content" source="../media/select-project.png" alt-text="Screenshot of conversational language understanding tab in the Azure AI Foundry.":::
105105

106-
1. In **Create CLU fine tuning task** window, complete the **Name** and **Language** fields. If you're using the free **Standard Training** mode, select **English** for the language field.
106+
1. In **Create CLU fine tuning task** window, select your **Connected service** from the drop-down menu, then complete the **Name** and **Language** fields. If you're using the free **Standard Training** mode, select **English** for the language field.
107+
108+
1. Select the **Create** button. It may take a few minutes for the create operation to complete.
107109

108110
> [!NOTE]
109111
>
Loading

articles/ai-services/language-service/toc.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -148,10 +148,10 @@ items:
148148
href: ../containers/azure-container-instance-recipe.md?context=/azure/ai-services/language-service/context/context
149149
- name: Azure AI containers overview
150150
href: ../cognitive-services-container-support.md
151-
- name: Create a CLU Foundry project
151+
- name: Create a fine-tuning task project
152152
href: conversational-language-understanding/how-to/create-project.md
153153
displayName: creation, clu project, setup
154-
- name: Build a schema
154+
- name: Build a fine-tuning schema
155155
href: conversational-language-understanding/how-to/build-schema.md
156156
displayName: design, intents, entities, conversational model
157157
- name: Label utterances

0 commit comments

Comments
 (0)