Skip to content

Commit 0c19a27

Browse files
authored
Merge pull request #4755 from MicrosoftDocs/release-build-2025-azure-ai-language
Release build 2025 azure ai language
2 parents 526a65c + 83b4d65 commit 0c19a27

File tree

16 files changed

+946
-52
lines changed

16 files changed

+946
-52
lines changed

articles/ai-services/language-service/conversational-language-understanding/how-to/create-project.md

Lines changed: 9 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,19 +6,18 @@ author: jboback
66
manager: nitinme
77
ms.service: azure-ai-language
88
ms.topic: how-to
9-
ms.date: 11/21/2024
9+
ms.date: 05/01/2025
1010
ms.author: jboback
1111
ms.custom: language-service-clu
1212
---
1313

14-
# How to create a CLU project
14+
# How to create a CLU fine-tuning task
1515

1616
Use this article to learn how to set up these requirements and create a project.
1717

18-
1918
## Prerequisites
2019

21-
Before you start using CLU, you will need several things:
20+
Before you start using CLU, you will need a few items:
2221

2322
* An Azure subscription - [Create one for free](https://azure.microsoft.com/free/cognitive-services).
2423
* An Azure AI Language resource
@@ -43,7 +42,7 @@ Before you start using CLU, you will need an Azure AI Language resource.
4342

4443
Once you have a Language resource created, create a Conversational Language Understanding project.
4544

46-
### [Language Studio](#tab/language-studio)
45+
### [Azure AI Foundry](#tab/azure-ai-foundry)
4746

4847
[!INCLUDE [Create project](../includes/language-studio/create-project.md)]
4948

@@ -55,7 +54,7 @@ Once you have a Language resource created, create a Conversational Language Unde
5554

5655
## Import project
5756

58-
### [Language Studio](#tab/language-studio)
57+
### [Azure AI Foundry](#tab/azure-ai-foundry)
5958

6059
You can export a Conversational Language Understanding project as a JSON file at any time by going to the conversation projects page, selecting a project, and from the top menu, clicking on **Export**.
6160

@@ -79,11 +78,11 @@ You can import a CLU JSON into the service
7978

8079
## Export project
8180

82-
### [Language Studio](#tab/Language-Studio)
81+
### [Azure AI Foundry](#tab/azure-ai-foundry)
8382

8483
You can export a Conversational Language Understanding project as a JSON file at any time by going to the conversation projects page, selecting a project, and pressing **Export**.
8584

86-
### [REST APIs](#tab/rest-apis)
85+
### [REST APIs](#tab/rest-api)
8786

8887
You can export a Conversational Language Understanding project as a JSON file at any time.
8988

@@ -93,7 +92,7 @@ You can export a Conversational Language Understanding project as a JSON file at
9392

9493
## Get CLU project details
9594

96-
### [Language Studio](#tab/language-studio)
95+
### [Azure AI Foundry](#tab/azure-ai-foundry)
9796

9897
[!INCLUDE [Language Studio project details](../includes/language-studio/project-details.md)]
9998

@@ -105,7 +104,7 @@ You can export a Conversational Language Understanding project as a JSON file at
105104

106105
## Delete project
107106

108-
### [Language Studio](#tab/language-studio)
107+
### [Azure AI Foundry](#tab/azure-ai-foundry)
109108

110109
[!INCLUDE [Delete project](../includes/language-studio/delete-project.md)]
111110

articles/ai-services/language-service/conversational-language-understanding/how-to/view-model-evaluation.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ See the [project development lifecycle](../overview.md#project-development-lifec
2929

3030
## Model details
3131

32-
### [Language studio](#tab/Language-studio)
32+
### [Azure AI Foundry](#tab/azure-ai-foundry)
3333

3434
[!INCLUDE [Model performance](../includes/language-studio/model-performance.md)]
3535

@@ -41,7 +41,7 @@ See the [project development lifecycle](../overview.md#project-development-lifec
4141

4242
## Load or export model data
4343

44-
### [Language studio](#tab/Language-studio)
44+
### [Azure AI Foundry](#tab/azure-ai-foundry)
4545

4646
[!INCLUDE [Load export model](../includes/language-studio/load-export-model.md)]
4747

@@ -54,7 +54,7 @@ See the [project development lifecycle](../overview.md#project-development-lifec
5454

5555
## Delete model
5656

57-
### [Language studio](#tab/Language-studio)
57+
### [Azure AI Foundry](#tab/azure-ai-foundry)
5858

5959
[!INCLUDE [Delete model](../includes/language-studio/delete-model.md)]
6060

articles/ai-services/language-service/conversational-language-understanding/includes/language-studio/create-project.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -25,5 +25,4 @@ To create a new project you need to provide the following details:
2525
|Utterances primary language | The primary language of your project. Your training data should primarily be in this language. |
2626
|Enable multiple languages | Whether you would like to enable your project to support [multiple languages](../../language-support.md#multi-lingual-option) at once. |
2727

28-
Once you're done, select **Next** and review the details. Select **create** to complete the process. You should now see the **Build Schema** screen in your project.
29-
28+
Once you're done, select **Create**. You should now see the Getting started landing page in your project.

articles/ai-services/language-service/conversational-language-understanding/includes/quickstarts/rest-api.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,11 @@ ms.author: jboback
2424

2525
:::image type="content" source="../../../media/azure-portal-resource-credentials.png" alt-text="A screenshot showing the key and endpoint page in the Azure portal" lightbox="../../../media/azure-portal-resource-credentials.png":::
2626

27+
## Import a new CLU fine-tuning project
2728

29+
Once you have a Language resource or an Azure AI resource created, create a fine-tuning task and select Azure AI language and select Conversational language understanding as the task type. A task is a work area for building your custom models based on your data. Your task can only be accessed by you and others who have access to the resource being used.
30+
31+
For this quickstart, you can download [this sample](https://github.com/Azure-Samples/cognitive-services-sample-data-files/blob/master/language-service/CLU/EmailAppDemo.json) and import it. This task can predict the intended commands from user input, such as: reading emails, deleting emails, and attaching a document to an email.
2832

2933
## Import a new CLU sample project
3034

articles/ai-services/language-service/conversational-language-understanding/language-support.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: jboback
66
manager: nitinme
77
ms.service: azure-ai-language
88
ms.topic: conceptual
9-
ms.date: 11/21/2024
9+
ms.date: 05/01/2025
1010
ms.author: jboback
1111
ms.custom: language-service-clu
1212
---
@@ -18,7 +18,7 @@ Use this article to learn about the languages currently supported by CLU feature
1818
## Multi-lingual option
1919

2020
> [!TIP]
21-
> See [How to train a model](how-to/train-model.md#training-modes) for information on which training mode you should use for multilingual projects.
21+
> We recommend using English for the LLM-powered features, like Quick Deploy and Conversation-level understanding, but your project will continue to function for all languages.
2222
2323
With conversational language understanding, you can train a model in one language and use to predict intents and entities from utterances in another language. This feature is powerful because it helps save time and effort. Instead of building separate projects for every language, you can handle multi-lingual dataset in one project. Your dataset doesn't have to be entirely in the same language but you should enable the multi-lingual option for your project while creating or later in project settings. If you notice your model performing poorly in certain languages during the evaluation process, consider adding more data in these languages to your training set.
2424

@@ -147,8 +147,6 @@ Conversational language understanding supports utterances in the following langu
147147
| Chinese (Traditional) | `zh-hant` |
148148
| Zulu | `zu` |
149149

150-
151-
152150
## Next steps
153151

154152
* [Conversational language understanding overview](overview.md)
146 KB
Loading

articles/ai-services/language-service/conversational-language-understanding/overview.md

Lines changed: 28 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,16 @@ author: jboback
66
manager: nitinme
77
ms.service: azure-ai-language
88
ms.topic: overview
9-
ms.date: 03/24/2025
9+
ms.date: 05/01/2025
1010
ms.author: jboback
1111
ms.custom: language-service-clu
1212
---
1313

1414
# What is conversational language understanding?
1515

16-
Conversational language understanding is one of the custom features offered by [Azure AI Language](../overview.md). It is a cloud-based API service that applies machine-learning intelligence to enable you to build natural language understanding component to be used in an end-to-end conversational application.
16+
Conversational language understanding is one of the custom features offered by [Azure AI Language](../overview.md). It's a cloud-based API service that applies machine-learning intelligence to enable you to build natural language understanding component to be used in an end-to-end conversational application.
1717

18-
Conversational language understanding (CLU) enables users to build custom natural language understanding models to predict the overall intention of an incoming utterance and extract important information from it. CLU only provides the intelligence to understand the input text for the client application and doesn't perform any actions. By creating a CLU project, developers can iteratively label utterances, train and evaluate model performance before making it available for consumption. The quality of the labeled data greatly impacts model performance. To simplify building and customizing your model, the service offers a custom web portal that can be accessed through the [Language studio](https://aka.ms/languageStudio). You can easily get started with the service by following the steps in this [quickstart](quickstart.md).
18+
Conversational language understanding (CLU) enables users to build custom natural language understanding models to predict the overall intention of an incoming utterance and extract important information from it. CLU only provides the intelligence to understand the input text for the client application and doesn't perform any actions. By creating a CLU project, developers can iteratively label utterances, train and evaluate model performance before making it available for consumption. The quality of the labeled data greatly impacts model performance. To simplify building and customizing your model, the service offers a custom web portal that can be accessed through the [Azure AI Foundry](https://language.cognitive.azure.com/). You can easily get started with the service by following the steps in this [quickstart](quickstart.md).
1919

2020
This documentation contains the following article types:
2121

@@ -26,7 +26,7 @@ This documentation contains the following article types:
2626

2727
## Example usage scenarios
2828

29-
CLU can be used in multiple scenarios across a variety of industries. Some examples are:
29+
CLU can be used in multiple scenarios across various industries. Some examples are:
3030

3131
### End-to-end conversational bot
3232

@@ -42,18 +42,36 @@ When you integrate a client application with a speech to text component, users c
4242

4343
### Enterprise chat bot
4444

45-
In a large corporation, an enterprise chat bot may handle a variety of employee affairs. It might handle frequently asked questions served by a custom question answering knowledge base, a calendar specific skill served by conversational language understanding, and an interview feedback skill served by LUIS. Use Orchestration workflow to connect all these skills together and appropriately route the incoming requests to the correct service.
45+
In a large corporation, an enterprise chat bot may handle various employee affairs. It might handle frequently asked questions served by a custom question answering knowledge base, a calendar specific skill served by conversational language understanding, and an interview feedback skill served by LUIS. Use Orchestration workflow to connect all these skills together and appropriately route the incoming requests to the correct service.
4646

47+
### Agents
48+
49+
CLU is utilized by the [intent routing](https://aka.ms/intent-triage-agent-template) agent template, which detects user intent and provides exact answering. Perfect for deterministically intent routing and exact question answering with human control.
4750

4851
## Project development lifecycle
4952

50-
Creating a CLU project typically involves several different steps.
53+
Creating a CLU project typically involves several different steps.
54+
55+
:::image type="content" source="media/llm-quick-deploy.png" alt-text="Chart of the LLM-powered quick deploy path." lightbox="media/llm-quick-deploy.png":::
56+
57+
> [!NOTE]
58+
> In the Azure AI Foundry, you’ll create a fine-tuning task as your workspace for customizing your CLU model. Formerly, a CLU fine-tuning task was called a CLU project. You may see these terms used interchangeably in legacy CLU documentation.
59+
60+
CLU offers two paths for you to get the most out of your implementation.
61+
62+
Option 1 (LLM-powered quick deploy):
63+
64+
1. **Define your schema**: Know your data and define the actions and relevant information that needs to be recognized from user's input utterances. In this step, you create the intents and provide a detailed description on the meaning of your intents that you want to assign to user's utterances.
65+
66+
2. **Deploy the model**: Deploying a model with the LLM-based training config makes it available for use via the Runtime API.
67+
68+
3. **Predict intents and entities**: Use your custom model deployment to predict custom intents and prebuilt entities from user’s utterances.
5169

52-
:::image type="content" source="media/development-lifecycle.png" alt-text="The development lifecycle" lightbox="media/development-lifecycle.png":::
70+
Option 2 (Custom machine learned model)
5371

54-
Follow these steps to get the most out of your model:
72+
Follow these steps to get the most out of your trained model:
5573

56-
1. **Define your schema**: Know your data and define the actions and relevant information that needs to be recognized from user's input utterances. In this step you create the [intents](glossary.md#intent) that you want to assign to user's utterances, and the relevant [entities](glossary.md#entity) you want extracted.
74+
1. **Define your schema**: Know your data and define the actions and relevant information that needs to be recognized from user's input utterances. In this step, you create the [intents](glossary.md#intent) that you want to assign to user's utterances, and the relevant [entities](glossary.md#entity) you want extracted.
5775

5876
2. **Label your data**: The quality of data labeling is a key factor in determining model performance.
5977

@@ -80,7 +98,7 @@ As you use CLU, see the following reference documentation and samples for Azure
8098

8199
## Responsible AI
82100

83-
An AI system includes not only the technology, but also the people who will use it, the people who will be affected by it, and the environment in which it's deployed. Read the transparency note for CLU to learn about responsible AI use and deployment in your systems. You can also see the following articles for more information:
101+
An AI system includes not only the technology, but also the people who use it, the people who are affected by it, and the environment in which it's deployed. Read the transparency note for CLU to learn about responsible AI use and deployment in your systems. You can also see the following articles for more information:
84102

85103
[!INCLUDE [Responsible AI links](../includes/overview-responsible-ai-links.md)]
86104

articles/ai-services/language-service/conversational-language-understanding/quickstart.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -6,17 +6,17 @@ author: jboback
66
manager: nitinme
77
ms.service: azure-ai-language
88
ms.topic: quickstart
9-
ms.date: 04/29/2025
9+
ms.date: 05/01/2025
1010
ms.author: jboback
1111
ms.custom: language-service-clu, mode-other
12-
zone_pivot_groups: usage-custom-language-features
12+
zone_pivot_groups: usage-custom-language-features-foundry
1313
---
1414

1515
# Quickstart: Conversational language understanding
1616

17-
Use this article to get started with Conversational Language understanding using Language Studio and the REST API. Follow these steps to try out an example.
17+
Use this article to get started with Conversational Language understanding using Azure AI Foundry and the REST API. Follow these steps to try out an example.
1818

19-
::: zone pivot="language-studio"
19+
::: zone pivot="azure-ai-foundry"
2020

2121
[!INCLUDE [Language Studio quickstart](includes/quickstarts/language-studio.md)]
2222

articles/ai-services/language-service/overview.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,10 @@ The Language service also provides several new features as well, which can eithe
2323
* Preconfigured, which means the AI models that the feature uses aren't customizable. You just send your data, and use the feature's output in your applications.
2424
* Customizable, which means you train an AI model using our tools to fit your data specifically.
2525

26+
Language features are also utilized in [agent templates](https://aka.ms/ai-agent-catalog):
27+
* [Intent routing](https://aka.ms/intent-triage-agent-template) detects user intent and provides exact answering. Perfect for deterministically intent routing and exact question answering with human controls.
28+
* [Exact question answering](https://aka.ms/exact-answer-agent-template) answers high-value predefined questions deterministically to ensure consistent and accurate responses.
29+
2630
> [!TIP]
2731
> Unsure which feature to use? See [Which Language service feature should I use](#which-language-service-feature-should-i-use) to help you decide.
2832

0 commit comments

Comments
 (0)