You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/concepts/data-formats.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ If you're uploading your data into conversational language understanding, it mus
17
17
18
18
## Import project file format
19
19
20
-
If you're [importing a project](../how-to/create-project.md#import-a-project) into conversational language understanding, the file uploaded must be in the following format:
20
+
If you're [importing a project](../how-to/create-project.md#import-an-existing-azure-ai-project) into conversational language understanding, the file uploaded must be in the following format:
21
21
22
22
```json
23
23
{
@@ -101,7 +101,7 @@ If you're [importing a project](../how-to/create-project.md#import-a-project) in
101
101
|Key |Placeholder |Value | Example |
102
102
|---------|---------|----------|--|
103
103
|`{API-VERSION}`| The [version](../../concepts/model-lifecycle.md#api-versions) of the API you're calling. |`2023-04-01`|
104
-
|`confidenceThreshold`|`{CONFIDENCE-THRESHOLD}`|This is the threshold score below which the intent is predicted as [None intent](none-intent.md). Values are from `0` to `1`.|`0.7`|
104
+
|`confidenceThreshold`|`{CONFIDENCE-THRESHOLD}`|The threshold score for which the intent is predicted as [None intent](none-intent.md). Values are from `0` to `1`.|`0.7`|
105
105
|`projectName`|`{PROJECT-NAME}`| The name of your project. This value is case sensitive. |`EmailApp`|
106
106
|`multilingual`|`true`| A Boolean value that enables you to have utterances in multiple languages in your dataset. When your model is deployed, you can query the model in any supported language (not necessarily included in your training documents. For more information about supported language codes, see [Language support](../language-support.md#multi-lingual-option). |`true`|
107
107
|`sublists`|`[]`|Array that contains sublists. Each sublist is a key and its associated values.|`[]`|
@@ -110,7 +110,7 @@ If you're [importing a project](../how-to/create-project.md#import-a-project) in
110
110
|`language`|`{LANGUAGE-CODE}`| A string specifying the language code for the utterances, synonyms, and regular expressions used in your project. If your project is a multilingual project, choose the [language code](../language-support.md) of most the utterances. |`en-us`|
111
111
|`intents`|`[]`| Array that contains all the intents you have in the project. These intents are classified from your utterances.|`[]`|
112
112
|`entities`|`[]`| Array that contains all the entities in your project. These entities are extracted from your utterances. Every entity can have other optional components defined with them: list, prebuilt, or regex. |`[]`|
113
-
|`dataset`|`{DATASET}`| The test set to which this utterance goes to when it's split before training. To learn more about data splitting, see [Train your conversational language understanding model](../how-to/train-model.md#data-splitting). Possible values for this field are `Train` and `Test`. |`Train`|
113
+
|`dataset`|`{DATASET}`| The test set that this utterance is assigned to when the data is split before training. To learn more about data splitting, see [Train your conversational language understanding model](../how-to/train-model.md#data-splitting). Possible values for this field are `Train` and `Test`. |`Train`|
114
114
|`category`|``| The type of entity associated with the span of text specified. |`Entity1`|
115
115
|`offset`|``| The inclusive character position of the start of the entity. |`5`|
116
116
|`length`|``| The character length of the entity. |`5`|
@@ -166,7 +166,7 @@ Conversational language understanding offers the option to upload your utterance
|`language`|`{LANGUAGE-CODE}`| A string that specifies the language code for the utterances used in your project. If your project is a multilingual project, choose the language code of most of the utterances. For more information about supported language codes, see [Language support](../language-support.md). |`en-us`|
169
-
|`dataset`|`{DATASET}`| The test set to which this utterance goes to when it's split before training. To learn more about data splitting, see [Train your conversational language understanding model](../how-to/train-model.md#data-splitting). Possible values for this field are `Train` and `Test`. |`Train`|
169
+
|`dataset`|`{DATASET}`| The test set that this utterance is assigned to when the data is split before training. To learn more about data splitting, see [Train your conversational language understanding model](../how-to/train-model.md#data-splitting). Possible values for this field are `Train` and `Test`. |`Train`|
|`entity`|`{entity}`|The entity to be extracted.| entity1|
172
172
|`category`|``| The type of entity associated with the span of text specified. |`Entity1`|
@@ -175,5 +175,5 @@ Conversational language understanding offers the option to upload your utterance
175
175
176
176
## Related content
177
177
178
-
* For more information on importing your labeled data into your project directly, see [Import project](../how-to/create-project.md#import-a-project).
178
+
* For more information on importing your labeled data into your project directly, see [Import project](../how-to/create-project.md#import-an-existing-azure-ai-project).
179
179
* For more information about labeling your data, see [Label your utterances in Language Studio](../how-to/tag-utterances.md). After you label your data, you can [train your model](../how-to/train-model.md).
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/how-to/create-project.md
+52-39Lines changed: 52 additions & 39 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,64 +6,45 @@ author: laujan
6
6
manager: nitinme
7
7
ms.service: azure-ai-language
8
8
ms.topic: how-to
9
-
ms.date: 05/01/2025
9
+
ms.date: 07/23/2025
10
10
ms.author: lajanuar
11
11
ms.custom: language-service-clu
12
12
---
13
13
14
-
# Create a CLU fine-tuning task
14
+
# Create a CLU project in Azure AI Foundry
15
15
16
-
Use this article to learn how to set up these requirements and create a project.
16
+
Azure AI Foundry projects help you organize your work when exploring new ideas or developing prototypes for specific use cases. A Foundry project is created on an Azure AI Foundry resource. This type of project offers an easy setup and provides access to agents and Azure AI models.
17
+
18
+
If you already have an Azure AI Language or multi-service resource—whether used on its own or through Language Studio—you can continue to use those existing Language resources within the Azure AI Foundry portal. For more information, see [How to use Azure AI services in the Azure AI Foundry portal](../../../../ai-services/connect-services-ai-foundry-portal.md).
17
19
18
20
## Prerequisites
19
21
20
22
* An Azure subscription. If you don't have one, you can [create one for free](https://azure.microsoft.com/free/cognitive-services).
21
-
* An Azure AI Language resource.
22
-
23
-
### Create a Language resource
24
-
25
-
Before you start using conversational language understanding (CLU), you need an Azure AI Language resource.
26
-
27
-
> [!NOTE]
28
-
> You need to have an Owner role assigned for the resource group to create a Language resource.
29
-
30
-
[!INCLUDE [create a new resource from the Azure portal](../includes/resource-creation-azure-portal.md)]
31
-
32
-
[!INCLUDE [create a new resource from Language Studio](../includes/resource-creation-language-studio.md)]
33
-
34
-
## Sign in to Language Studio
23
+
***Requisite permissions**. Make sure the person establishing the account and project is assigned as the Azure AI Account Owner role at the subscription level. Alternatively, having either the **Contributor** or **Cognitive Services Contributor** role at the subscription scope also meets this requirement. For more information, *see*[Role based access control (RBAC)](../../../openai/how-to/role-based-access-control.md#cognitive-services-contributor).
24
+
* An [Azure AI Foundry resource](../../../multi-service-resource.md)
25
+
* For more information, *see*[Configure an Azure AI Foundry resource](configure-azure-resources.md#option-1-configure-an-azure-ai-foundry-resource).
26
+
* After you create an Azure AI Foundry resource, [create a CLU project](#create-a-clu-project).
35
27
36
-
[!INCLUDE [Sign in to Language studio](../includes/language-studio/sign-in-studio.md)]
28
+
## Create a CLU project
37
29
38
-
## Create a conversation project
39
-
40
-
After you create a Language resource, create a CLU project.
30
+
An Azure AI Foundry project is created using an Azure AI Foundry resource. Projects are designed to help you organize your work. They offer various tools and resources that support the development, customization, and management of AI applications all within a centralized environment.
You can export a CLU project as a JSON file at any time. On the conversation projects page, select a project, and on the top menu, select **Export**.
57
-
58
-
:::image type="content" source="../media/export.png" alt-text="A screenshot that shows the CLU Export button." lightbox="../media/export.png":::
59
-
60
-
You can reimport that project as a new project. If you import a project with the exact same name, it replaces the project's data with the newly imported project's data.
61
-
62
-
If you have an existing Language Understanding (LUIS) application, you can _import_ the LUIS application JSON to CLU directly. It creates a Conversation project with all the pieces that are currently available: intents, machine learning entities, and utterances. For more information, see [Migrate from Language Understanding (LUIS) to conversational language understanding (CLU)](../how-to/migrate-from-luis.md).
63
-
64
-
To import a project, select the arrow button next to **Create a new project** and select **Import**. Then select the LUIS or CLU JSON file.
65
-
66
-
:::image type="content" source="../media/import.png" alt-text="A screenshot that shows the CLU Import button." lightbox="../media/import.png":::
47
+
To import an existing Azure AI services project with Azure AI Foundry, you need to create a connection to the Azure AI services resource within your Azure AI Foundry project. For more information, *see*[Connect Azure AI Services projects to Azure AI Foundry](../../../../ai-services/connect-services-ai-foundry-portal.md)
67
48
68
49
### [REST APIs](#tab/rest-api)
69
50
@@ -77,7 +58,13 @@ You can import a CLU JSON into the service.
77
58
78
59
### [Azure AI Foundry](#tab/azure-ai-foundry)
79
60
80
-
You can export a CLU project as a JSON file at any time. On the conversation projects page, select a project, and then select **Export**.
61
+
You can download a CLU project as a **config.json** file:
62
+
63
+
1. Navigate to your project home page.
64
+
1. At the top of the page, select your project from the right page ribbon area.
65
+
1. Select **Download config file**.
66
+
67
+
:::image type="content" source="../media/create-project/download-config-json.png" alt-text="Screenshot of project drop-down menu with the download config file hyperlink in the Azure AI Foundry.":::
81
68
82
69
### [REST APIs](#tab/rest-api)
83
70
@@ -87,11 +74,18 @@ You can export a CLU project as a JSON file at any time.
87
74
88
75
---
89
76
90
-
## Get CLU project details
77
+
## View and manage project details
91
78
92
79
### [Azure AI Foundry](#tab/azure-ai-foundry)
93
80
94
-
[!INCLUDE [Language Studio project details](../includes/language-studio/project-details.md)]
81
+
* On the project Home page, information about the project is found in the **Project details** section.
82
+
* To view project settings, select **Management center** from the bottom of the left navigation pane, then select one of the following tabs:
83
+
***Overview** to view project details.
84
+
***Users** to manage users and roles.
85
+
***Models + endpoints** to manage deployments of your models and services.
86
+
***Connected resources** to manage connected resources for the project.
87
+
88
+
:::image type="content" source="../media/create-project/project-details.png" alt-text="Screenshot of the project details list in the Azure AI Foundry.":::
95
89
96
90
### [REST APIs](#tab/rest-api)
97
91
@@ -103,11 +97,30 @@ You can export a CLU project as a JSON file at any time.
If you no longer need your project, you can delete it from the Azure AI Foundry.
102
+
103
+
1. Navigate to the [Azure AI Foundry](https://ai.azure.com/) home page. Initiate the authentication process by signing in, unless you already completed this step and your session is active.
104
+
1. Select the project that you want to delete from the **Keep building with Azure AI Foundry**
105
+
1. Select **Management center**.
106
+
1. Select **Delete project**.
107
+
108
+
:::image type="content" source="../media/create-project/delete-project.png" alt-text="Screenshot of the Delete project button in the Azure AI Foundry.":::
109
+
110
+
To delete the hub along with all its projects:
111
+
112
+
1. Navigate to the **Overview** tab inn the **Hub** section.
113
+
114
+
:::image type="content" source="../media/create-project/hub-details.png" alt-text="Screenshot of the hub details list in the Azure AI Foundry.":::
115
+
116
+
1. On the right, select **Delete hub**.
117
+
1. The link opens the Azure portal for you to delete the hub there.
118
+
119
+
:::image type="content" source="../media/create-project/delete-hub.png" alt-text="Screenshot of the Delete hub button in the Azure AI Foundry.":::
107
120
108
121
### [REST APIs](#tab/rest-api)
109
122
110
-
When you don't need your project anymore, you can use the APIs to delete your project.
123
+
If you no longer need your project, delete it using the REST API.
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/how-to/tag-utterances.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,7 +15,7 @@ ms.custom: language-service-clu
15
15
16
16
After you [build a schema](build-schema.md) for your fine-tuning task, you add training utterances to your project. The utterances should be similar to what your users use when they interact with the project. When you add an utterance, you have to assign which intent it belongs to. After the utterance is added, label the words within your utterance that you want to extract as entities.
17
17
18
-
Data labeling is a crucial step in the conversational language understanding (CLU) trained development lifecycle. This data is used in the next step when you train your model so that your model can learn from the labeled data. If you already labeled utterances, you can directly [import them into your project](create-project.md#import-a-project), if your data follows the [accepted data format](../concepts/data-formats.md). To learn more about importing labeled data, see [Create a CLU fine-tuning task](create-project.md#import-a-project). Labeled data informs the model about how to interpret text and is used for training and evaluation.
18
+
Data labeling is a crucial step in the conversational language understanding (CLU) trained development lifecycle. This data is used in the next step when you train your model so that your model can learn from the labeled data. If you already labeled utterances, you can directly [import them into your project](create-project.md#import-an-existing-azure-ai-project), if your data follows the [accepted data format](../concepts/data-formats.md). To learn more about importing labeled data, see [Create a CLU fine-tuning task](create-project.md#import-an-existing-azure-ai-project). Labeled data informs the model about how to interpret text and is used for training and evaluation.
19
19
20
20
> [!TIP]
21
21
> Use the **Quick Deploy** option to implement custom CLU intent routing, which is powered by your own large language model deployment without adding or labeling any training data.
@@ -43,9 +43,9 @@ As you add utterances and label them, keep in mind:
43
43
44
44
* For [multilingual projects](../language-support.md#multi-lingual-option), adding utterances in other languages increases the model's performance in these languages. Avoid duplicating your data across all the languages that you want to support. For example, to improve a calender bot's performance with users, a developer might add examples mostly in English and a few in Spanish or French. They might add utterances such as:
45
45
46
-
*"Set a meeting with **Matt** and **Kevin****tomorrow** at **12 PM**." (English)
47
-
*"Reply as **tentative** to the **weekly update** meeting." (English)
48
-
*"Cancelar mi **próxima** reunión." (Spanish)
46
+
*`Set a meeting with **Matt** and **Kevin** **tomorrow** at **12 PM**.` (English)
47
+
*`Reply as **tentative** to the **weekly update** meeting.` (English)
48
+
*`Cancelar mi **próxima** reunión.` (Spanish)
49
49
50
50
## Label your utterances
51
51
@@ -111,7 +111,7 @@ Before you get started, the suggested utterances feature is available only if yo
111
111
112
112
On the **Data labeling** page:
113
113
114
-
1. Select **Suggest utterances**. A pane opens on the right and prompts you to select your Azure OpenAI resource and deployment.
114
+
1. Select **Suggest utterances**. A pane opens and prompts you to select your Azure OpenAI resource and deployment.
115
115
1. After you select an Azure OpenAI resource, select **Connect** so that your Language resource has direct access to your Azure OpenAI resource. It assigns your Language resource the **Cognitive Services User** role to your Azure OpenAI resource. Now your current Language resource has access to Azure OpenAI. If the connection fails, follow [these steps](#add-required-configurations-to-azure-openai-resource) to manually add the correct role to your Azure OpenAI resource.
116
116
1. After the resource is connected, select the deployment. The model that we recommend for the Azure OpenAI deployment is `gpt-35-turbo-instruct`.
117
117
1. Select the intent for which you want to get suggestions. Make sure the intent that you selected has at least five saved utterances to be enabled for utterance suggestions. The suggestions provided by Azure OpenAI are based on the most recent utterances that you added for that intent.
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/how-to/train-model.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,8 +28,8 @@ Model evaluation is triggered automatically after training is completed successf
28
28
## Prerequisites
29
29
30
30
***An active Azure subscription**. If you don't have one, you can [create one for free](https://azure.microsoft.com/free/cognitive-services).
31
-
***Requisite permissions**. Make sure the person establishing the account and project is assigned as the Azure AI Account Owner role at the subscription level. Alternatively, having either the **Contributor** or **Cognitive Services Contributor** role at the subscription scope also meets this requirement. For more information, *see*[Role based access control (RBAC)](../../../openai/how-to/role-based-access-control.md#cognitive-services-contributor)
32
-
***A project created in the Azure AI Foundry**. For more information, *see*[Create an AI Foundry project](../../../../ai-foundry/how-to/create-projects.md)
31
+
***Requisite permissions**. Make sure the person establishing the account and project is assigned as the Azure AI Account Owner role at the subscription level. Alternatively, having either the **Contributor** or **Cognitive Services Contributor** role at the subscription scope also meets this requirement. For more information, *see*[Role based access control (RBAC)](../../../openai/how-to/role-based-access-control.md#cognitive-services-contributor).
32
+
***A project created in the Azure AI Foundry**. For more information, *see*[Create an AI Foundry project](../../../../ai-foundry/how-to/create-projects.md).
33
33
*[**Your labeled utterances**](tag-utterances.md) tagged for your fine tuning task.
0 commit comments