Merge pull request #96113 from diberry/diberry/1114-luis-howto-4

[Cogsvcs] LUIS - review endpoint utt

Author: v-shils

articles/cognitive-services/LUIS/luis-how-to-review-endpoint-utterances.md

@@ -9,83 +9,43 @@ ms.custom: seodec18
 ms.service: cognitive-services
 ms.subservice: language-understanding
 ms.topic: conceptual
-ms.date: 10/25/2019
+ms.date: 11/15/2019
 ms.author: diberry
 ---
 
-# How to review endpoint utterances in LUIS portal for active learning
+# How to improve the LUIS app by reviewing endpoint utterances
 
-[Active learning](luis-concept-review-endpoint-utterances.md) captures endpoint queries and selects user's endpoint utterances that it is unsure of. You review these utterances to select the intent and mark entities for these read-world utterances. Accept these changes into your example utterances then train and publish. LUIS then identifies utterances more accurately.
+The process of reviewing endpoint utterances for correct predictions is called [Active learning](luis-concept-review-endpoint-utterances.md). Active learning captures endpoint queries and selects user's endpoint utterances that it is unsure of. You review these utterances to select the intent and mark entities for these read-world utterances. Accept these changes into your example utterances then train and publish. LUIS then identifies utterances more accurately.
 
-[!INCLUDE [Waiting for LUIS portal refresh](./includes/wait-v3-upgrade.md)]
+If you have many people contributing to a LUIS app, 
 
-## Enable active learning
-
-To enable active learning, log user queries. This is accomplished by setting the [endpoint query](luis-get-started-create-app.md#query-the-v2-api-prediction-endpoint) with the `log=true` querystring parameter and value.
-
-## Disable active learning
-
-To disable active learning, don't log user queries. This is accomplished by setting the [endpoint query](luis-get-started-create-app.md#query-the-v2-api-prediction-endpoint) with the `log=false` querystring parameter and value.
-
-## Filter utterances
-
-1. Open your app (for example, TravelAgent) by selecting its name on **My Apps** page, then select **Build** in the top bar.
-
-1. Under the **Improve app performance**, select **Review endpoint utterances**.
-
-1. On the **Review endpoint utterances** page, select in the **Filter list by intent or entity** text box. This drop-down list includes all intents under **INTENTS** and all entities under **ENTITIES**.
-
-    ![Utterances filter](./media/label-suggested-utterances/filter.png)
-
-1. Select a category (intents or entities) in the drop-down list and review the utterances.
-
-    ![Intent utterances](./media/label-suggested-utterances/intent-utterances.png)
-
-## Label entities
-LUIS replaces entity tokens (words) with entity names highlighted in blue. If an utterance has unlabeled entities, label them in the utterance. 
+[!INCLUDE [Uses preview portal](includes/uses-portal-preview.md)]
 
-1. Select on the word(s) in the utterance. 
-
-1. Select an entity from the list.
+## Enable active learning
 
-    ![Label entity](./media/label-suggested-utterances/label-entity.png)
+To enable active learning, you must log user queries. This is accomplished by calling the [endpoint query](luis-get-started-create-app.md#query-the-v3-api-prediction-endpoint) with the `log=true` querystring parameter and value.
 
-## Align single utterance
+## Correct intent predictions to align utterances
 
 Each utterance has a suggested intent displayed in the **Aligned intent** column. 
 
-1. If you agree with that suggestion, select on the check mark.
-
-    ![Keep aligned intent](./media/label-suggested-utterances/align-intent-check.png)
-
-1. If you disagree with the suggestion, select the correct intent from the aligned intent drop-down list, then select on the check mark to the right of the aligned intent. 
-
-    ![Align intent](./media/label-suggested-utterances/align-intent.png)
-
-1. After you select on the check mark, the utterance is removed from the list. 
+> [!div class="mx-imgBorder"]
+> [![Review endpoint utterances that LUIS is unsure of](./media/label-suggested-utterances/review-endpoint-utterances.png)](./media/label-suggested-utterances/review-endpoint-utterances.png#lightbox)
 
-## Align several utterances
+If you agree with that intent, select the check mark. If you disagree with the suggestion, select the correct intent from the aligned intent drop-down list, then select on the check mark to the right of the aligned intent. After you select on the check mark, the utterance is moved to the intent and removed from the **Review Endpoint Utterances** list. 
 
-To align several utterances, check the box to the left of the utterances, then select on the **Add selected** button. 
-
-![Align several](./media/label-suggested-utterances/add-selected.png)
-
-## Verify aligned intent
-
-You can verify the utterance was aligned with the correct intent by going to the **Intents** page, select the intent name, and reviewing the utterances. The utterance from **Review endpoint utterances** is in the list.
+> [!TIP]
+> It is important to go to the Intent details page to review and correct the entity predictions from all example utterances from the **Review Endpoint Utterances** list.
 
 ## Delete utterance
 
 Each utterance can be deleted from the review list. Once deleted, it will not appear in the list again. This is true even if the user enters the same utterance from the endpoint. 
 
-If you are unsure if you should delete the utterance, either move it to the None intent, or create a new intent such as "miscellaneous" and move the utterance to that intent. 
+If you are unsure if you should delete the utterance, either move it to the None intent, or create a new intent such as `miscellaneous` and move the utterance to that intent. 
 
-## Delete several utterances
-
-To delete several utterances, select each item and select on the trash bin to the right of the **Add selected** button.
-
-![Delete several](./media/label-suggested-utterances/delete-several.png)
+## Disable active learning
 
+To disable active learning, don't log user queries. This is accomplished by setting the [endpoint query](luis-get-started-create-app.md#query-the-v2-api-prediction-endpoint) with the `log=false` querystring parameter and value or not using the querystring value because the default value is false.
 
 ## Next steps