Skip to content

Commit cfe3995

Browse files
authored
Merge pull request #102065 from diberry/diberry/0123-luis-active-learning
[Cogsvcs] LUIS - log=true
2 parents b73051f + 50573ce commit cfe3995

File tree

2 files changed

+11
-7
lines changed

2 files changed

+11
-7
lines changed

articles/cognitive-services/LUIS/luis-concept-review-endpoint-utterances.md

Lines changed: 10 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -9,30 +9,34 @@ ms.custom: seodec18
99
ms.service: cognitive-services
1010
ms.subservice: language-understanding
1111
ms.topic: conceptual
12-
ms.date: 10/10/2019
12+
ms.date: 01/23/2020
1313
ms.author: diberry
1414
---
1515
# Concepts for enabling active learning by reviewing endpoint utterances
1616
Active learning is one of three strategies to improve prediction accuracy and the easiest to implement. With active learning, your review endpoint utterances for correct intent and entity. LUIS chooses endpoint utterances it is unsure of.
1717

1818
## What is active learning
19-
Active learning is a two-step process. First, LUIS selects utterances it receives at the app's endpoint that need validation. The second step is performed by the app owner or collaborator to validate the selected utterances for [review](luis-how-to-review-endpoint-utterances.md), including the correct intent and any entities within the intent. After reviewing the utterances, train and publish the app again.
19+
Active learning is a two-step process. First, LUIS selects utterances it receives at the app's endpoint that need validation. The second step is performed by the app owner or collaborator to validate the selected utterances for [review](luis-how-to-review-endpoint-utterances.md), including the correct intent and any entities within the intent. After reviewing the utterances, train and publish the app again.
2020

2121
## Which utterances are on the review list
22-
LUIS adds utterances to the review list when the top firing intent has a low score or the top two intents' scores are too close.
22+
LUIS adds utterances to the review list when the top firing intent has a low score or the top two intents' scores are too close.
2323

2424
## Single pool for utterances per app
25-
The **Review endpoint utterances** list doesn't change based on the version. There is a single pool of utterances to review, regardless of which version the utterance you are actively editing or which version of the app was published at the endpoint.
25+
The **Review endpoint utterances** list doesn't change based on the version. There is a single pool of utterances to review, regardless of which version the utterance you are actively editing or which version of the app was published at the endpoint.
2626

2727
## Where are the utterances from
28-
Endpoint utterances are taken from end-user queries on the application’s HTTP endpoint. If your app is not published or has not received hits yet, you do not have any utterances to review. If no endpoint hits are received for a specific intent or entity, you do not have utterances to review that contain them.
28+
Endpoint utterances are taken from end-user queries on the application’s HTTP endpoint. If your app is not published or has not received hits yet, you do not have any utterances to review. If no endpoint hits are received for a specific intent or entity, you do not have utterances to review that contain them.
2929

3030
## Schedule review periodically
31-
Reviewing suggested utterances doesn't need to be done every day but should be part of your regular maintenance of LUIS.
31+
Reviewing suggested utterances doesn't need to be done every day but should be part of your regular maintenance of LUIS.
3232

3333
## Delete review items programmatically
3434
Use the **[delete unlabeled utterances](https://westus.dev.cognitive.microsoft.com/docs/services/5890b47c39e2bb17b84a55ff/operations/58b6f32139e2bb139ce823c9)** API. Back up these utterances before deletion by **[exporting the log files](https://westus.dev.cognitive.microsoft.com/docs/services/5890b47c39e2bb17b84a55ff/operations/5890b47c39e2bb052c5b9c36)**.
3535

36+
## Enable active learning
37+
38+
To enable active learning, you must log user queries. This is accomplished by calling the [endpoint query](luis-get-started-create-app.md#query-the-v3-api-prediction-endpoint) with the `log=true` querystring parameter and value.
39+
3640
## Next steps
3741

3842
* Learn how to [review](luis-how-to-review-endpoint-utterances.md) endpoint utterances

articles/cognitive-services/LUIS/luis-how-to-review-endpoint-utterances.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.custom: seodec18
99
ms.service: cognitive-services
1010
ms.subservice: language-understanding
1111
ms.topic: conceptual
12-
ms.date: 12/17/2019
12+
ms.date: 01/23/2020
1313
ms.author: diberry
1414
---
1515

0 commit comments

Comments
 (0)