You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/language-service/conversational-language-understanding/how-to/tag-utterances.md
+20-16Lines changed: 20 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,23 +11,26 @@ ms.author: jboback
11
11
ms.custom: language-service-clu
12
12
---
13
13
14
-
# Label your utterances in Language Studio
14
+
# Label your utterances in AI Foundry
15
15
16
-
Once you have [built a schema](build-schema.md) for your project, you should add training utterances to your project. The utterances should be similar to what your users use when interacting with the project. When you add an utterance, you have to assign which intent it belongs to. After the utterance is added, label the words within your utterance that you want to extract as entities.
16
+
Once you have [built a schema](build-schema.md) for your fine-tuning task, you should add training utterances to your project. The utterances should be similar to what your users use when interacting with the project. When you add an utterance, you have to assign which intent it belongs to. After the utterance is added, label the words within your utterance that you want to extract as entities.
17
17
18
-
Data labeling is a crucial step in development lifecycle; this data are used in the next step when training your model so that your model can learn from the labeled data. If you already have labeled utterances, you can directly [import it into your project](create-project.md#import-project), but you need to make sure that your data follows the [accepted data format](../concepts/data-formats.md). See [create project](create-project.md#import-project) to learn more about importing labeled data into your project. Labeled data informs the model how to interpret text, and is used for training and evaluation.
18
+
Data labeling is a crucial step in the CLU trained development lifecycle; this data are used in the next step when training your model so that your model can learn from the labeled data. If you already have labeled utterances, you can directly [import it into your project](create-project.md#import-project), provided that your data follows the [accepted data format](../concepts/data-formats.md). See [create fine-tuning task](create-project.md#import-project) to learn more about importing labeled data. Labeled data informs the model how to interpret text and is used for training and evaluation.
19
+
20
+
> [!TIP]
21
+
> Use the **Quick Deploy** option to implement custom CLU intent routing, powered by your own LLM model deployment without adding or labeling any training data.
19
22
20
23
## Prerequisites
21
24
22
25
Before you can label your data, you need:
23
26
24
27
* A successfully [created project](create-project.md).
25
28
26
-
See the [project development lifecycle](../overview.md#project-development-lifecycle) for more information.
29
+
See the [CLU development lifecycle](../overview.md#project-development-lifecycle) for more information.
27
30
28
31
## Data labeling guidelines
29
32
30
-
After [building your schema](build-schema.md) and [creating your project](create-project.md), you need to label your data. Labeling your data is important so your model knows which words and sentences are associated with the intents and entities in your project. Spend time labeling your utterances - introducing and refining the data that is used in training your models.
33
+
After [building your schema](build-schema.md) and [creating your project](create-project.md), you need to label your data. Labeling your data is important so your model knows which sentences and words are associated with the intents and entities in your project. Spend time labeling your utterances - introducing and refining the data that is used in training your models.
31
34
32
35
As you add utterances and label them, keep in mind:
33
36
@@ -51,9 +54,9 @@ As you add utterances and label them, keep in mind:
51
54
52
55
Use the following steps to label your utterances:
53
56
54
-
1. Go to your project page in [Language Studio](https://aka.ms/languageStudio).
57
+
1. Go to your project page in [AI Foundry](https://ai.azure.com).
55
58
56
-
2. From the left side menu, select **Data labeling**. In this page, you can start adding your utterance and labeling them. You can also upload your utterance directly by clicking on **Upload utterance file** from the top menu, make sure it follows the [accepted format](../concepts/data-formats.md#utterance-file-format).
59
+
2. From the left side menu, select **Manage data**. In this page, you can start adding your utterances and labeling them. You can also upload your utterances directly by clicking on **Upload utterance file** from the top menu, make sure it follows the [accepted format](../concepts/data-formats.md#utterance-file-format).
57
60
58
61
3. From the top pivots, you can change the view to be **training set** or **testing set**. Learn more about [training and testing sets](train-model.md#data-splitting) and how they're used for model training and evaluation.
59
62
@@ -83,19 +86,22 @@ Use the following steps to label your utterances:
83
86
84
87
85
88
> [!NOTE]
86
-
> List and prebuilt components are not shown in the data labeling page, and all labels here only apply to the **learned component**.
89
+
> List, regex, and prebuilt components are not shown in the data labeling page, and all labels here only apply to the **learned component**.
87
90
88
91
To remove a label:
89
92
1. From within your utterance, select the entity you want to remove a label from.
90
93
3. Scroll through the menu that appears, and select **Remove label**.
91
94
92
95
To delete an entity:
93
-
1. Select the entity you want to edit in the right side pane.
94
-
2. Select the three dots next to the entity, and select the option you want from the drop-down menu.
96
+
1. Select the garbage bin icon next to the entity you want to edit in the right side pane. Then select **Delete** to confirm.
95
97
96
98
## Suggest utterances with Azure OpenAI
97
99
98
-
In CLU, use Azure OpenAI to suggest utterances to add to your project using GPT models. You first need to get access and create a resource in Azure OpenAI. You'll then need to create a deployment for the GPT models. Follow the pre-requisite steps [here](../../../openai/how-to/create-resource.md).
100
+
In CLU, use Azure OpenAI to suggest utterances to add to your project using generative language models. It is recommended to use an AI Foundry resource while using CLU, so you do not need to connect multiple resources. In order to use the AI Foundry resource, you'll need to provide your AI Foundry resource with elevated access. To do this, access the Azure Portal. Within your Azure AI resource, provide access as a *Cognitive Services User* to itself. This ensures that all parts of your resource are communicating correctly.
101
+
102
+
###Connecting with separate Language and AOAI Resources
103
+
104
+
You first need to get access and create a resource in Azure OpenAI. Next, you'll create a connection to the Azure OpenAI resource within the same AI Foundry project in the **Management center** in the left panel of the Azure AI Foundry page. You'll then need to create a deployment for the AOAI models within the connected AOAI resource. Follow the pre-requisite steps [here](../../../openai/how-to/create-resource.md) to create a new resource.
99
105
100
106
Before you get started, the suggest utterances feature is only available if your Language resource is in the following regions:
101
107
* East US
@@ -116,19 +122,17 @@ Using this feature entails a charge to your Azure OpenAI resource for a similar
116
122
117
123
### Add required configurations to Azure OpenAI resource
118
124
119
-
If connecting your Language resource to an Azure OpenAI resource fails, follow these steps:
120
-
121
125
Enable identity management for your Language resource using the following options:
122
126
123
-
### [Azure portal](#tab/portal)
127
+
####[Azure portal](#tab/portal)
124
128
125
129
Your Language resource must have identity management, to enable it using the [Azure portal](https://portal.azure.com):
126
130
127
131
1. Go to your Language resource
128
132
2. From left hand menu, under **Resource Management** section, select **Identity**
129
133
3. From **System assigned** tab, make sure to set **Status** to **On**
130
134
131
-
### [Language Studio](#tab/studio)
135
+
####[Language Studio](#tab/studio)
132
136
133
137
Your Language resource must have identity management, to enable it using [Language Studio](https://aka.ms/languageStudio):
134
138
@@ -152,7 +156,7 @@ After enabling managed identity, assign the role `Cognitive Services User` to yo
152
156
153
157
:::image type="content" source="../media/add-role-azure-openai.gif" alt-text="Multiple screenshots showing the steps to add the required role to your Azure OpenAI resource." lightbox="../media/add-role-azure-openai.gif":::
154
158
155
-
After a few minutes, refresh the Language Studio and you are able to successfully connect to Azure OpenAI.
159
+
After a few minutes, refresh the AI Foundry, and you can successfully connect to Azure OpenAI.
0 commit comments