You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cognitive-services/LUIS/luis-concept-review-endpoint-utterances.md
+10-6Lines changed: 10 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,30 +9,34 @@ ms.custom: seodec18
9
9
ms.service: cognitive-services
10
10
ms.subservice: language-understanding
11
11
ms.topic: conceptual
12
-
ms.date: 10/10/2019
12
+
ms.date: 01/23/2020
13
13
ms.author: diberry
14
14
---
15
15
# Concepts for enabling active learning by reviewing endpoint utterances
16
16
Active learning is one of three strategies to improve prediction accuracy and the easiest to implement. With active learning, your review endpoint utterances for correct intent and entity. LUIS chooses endpoint utterances it is unsure of.
17
17
18
18
## What is active learning
19
-
Active learning is a two-step process. First, LUIS selects utterances it receives at the app's endpoint that need validation. The second step is performed by the app owner or collaborator to validate the selected utterances for [review](luis-how-to-review-endpoint-utterances.md), including the correct intent and any entities within the intent. After reviewing the utterances, train and publish the app again.
19
+
Active learning is a two-step process. First, LUIS selects utterances it receives at the app's endpoint that need validation. The second step is performed by the app owner or collaborator to validate the selected utterances for [review](luis-how-to-review-endpoint-utterances.md), including the correct intent and any entities within the intent. After reviewing the utterances, train and publish the app again.
20
20
21
21
## Which utterances are on the review list
22
-
LUIS adds utterances to the review list when the top firing intent has a low score or the top two intents' scores are too close.
22
+
LUIS adds utterances to the review list when the top firing intent has a low score or the top two intents' scores are too close.
23
23
24
24
## Single pool for utterances per app
25
-
The **Review endpoint utterances** list doesn't change based on the version. There is a single pool of utterances to review, regardless of which version the utterance you are actively editing or which version of the app was published at the endpoint.
25
+
The **Review endpoint utterances** list doesn't change based on the version. There is a single pool of utterances to review, regardless of which version the utterance you are actively editing or which version of the app was published at the endpoint.
26
26
27
27
## Where are the utterances from
28
-
Endpoint utterances are taken from end-user queries on the application’s HTTP endpoint. If your app is not published or has not received hits yet, you do not have any utterances to review. If no endpoint hits are received for a specific intent or entity, you do not have utterances to review that contain them.
28
+
Endpoint utterances are taken from end-user queries on the application’s HTTP endpoint. If your app is not published or has not received hits yet, you do not have any utterances to review. If no endpoint hits are received for a specific intent or entity, you do not have utterances to review that contain them.
29
29
30
30
## Schedule review periodically
31
-
Reviewing suggested utterances doesn't need to be done every day but should be part of your regular maintenance of LUIS.
31
+
Reviewing suggested utterances doesn't need to be done every day but should be part of your regular maintenance of LUIS.
32
32
33
33
## Delete review items programmatically
34
34
Use the **[delete unlabeled utterances](https://westus.dev.cognitive.microsoft.com/docs/services/5890b47c39e2bb17b84a55ff/operations/58b6f32139e2bb139ce823c9)** API. Back up these utterances before deletion by **[exporting the log files](https://westus.dev.cognitive.microsoft.com/docs/services/5890b47c39e2bb17b84a55ff/operations/5890b47c39e2bb052c5b9c36)**.
35
35
36
+
## Enable active learning
37
+
38
+
To enable active learning, you must log user queries. This is accomplished by calling the [endpoint query](luis-get-started-create-app.md#query-the-v3-api-prediction-endpoint) with the `log=true` querystring parameter and value.
39
+
36
40
## Next steps
37
41
38
42
* Learn how to [review](luis-how-to-review-endpoint-utterances.md) endpoint utterances
0 commit comments