You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cognitive-services/QnAMaker/Quickstarts/batch-testing.md
+13-6Lines changed: 13 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ manager: nitinme
8
8
ms.service: cognitive-services
9
9
ms.subservice: qna-maker
10
10
ms.topic: quickstart
11
-
ms.date: 12/19/2019
11
+
ms.date: 02/08/2020
12
12
ms.author: diberry
13
13
---
14
14
@@ -19,7 +19,7 @@ Use the QnA Maker batch testing tool to test the knowledge bases in your QnA Mak
19
19
## Prerequisites
20
20
21
21
* Azure subscription - [create one for free](https://azure.microsoft.com/free/?WT.mc_id=A261C142F)
22
-
* Either [create a QnA Maker service](create-publish-knowledge-base.md#create-a-new-qna-maker-knowledge-base) or use an existing service, which uses the English language for the sample doc used in this quickstart.
22
+
* Either [create a QnA Maker service](create-publish-knowledge-base.md#create-a-new-qna-maker-knowledge-base) or use an existing service, which uses the English language.
23
23
* Download the [multi-turn sample `.docx` file](https://github.com/Azure-Samples/cognitive-services-sample-data-files/blob/master/qna-maker/data-source-formats/multi-turn.docx)
24
24
* Download the [batch testing tool](https://aka.ms/qnamakerbatchtestingtool), extract the executable file from the `.zip` file.
25
25
@@ -36,9 +36,16 @@ Use the QnA Maker batch testing tool to test the knowledge bases in your QnA Mak
36
36
* Azure QnA Service Name
37
37
* Language - the English language
38
38
1. Enter the name `Multi-turn batch test quickstart` as the name of your knowledge base.
39
-
1. In **Step 4**, check **Enable multi-turn extraction from URLs, .pdf or .docx files**.
40
-
1. Enter the **Default answer text** of `Quickstart - can't find answer`. In a production knowledge base, this information should be more instructive to the user but for this quickstart, a simple response works.
41
-
1. Still in **Step 4**, select **+ Add file** then select the downloaded `.docx` file listing in the prerequisites.
39
+
40
+
1. In **Step 4**, configure the settings with the following table:
41
+
42
+
|Setting|Value|
43
+
|--|--|
44
+
|**Enable multi-turn extraction from URLs, .pdf or .docx files.**|Checked|
45
+
|**Default answer text**|`Batch test - default answer not found.`|
46
+
|**+ Add File**|Select the downloaded `.docx` file listing in the prerequisites.|
47
+
|**Chit-chat**|Select **Professional**|
48
+
42
49
1. In **Step 5**, select **Create your KB**.
43
50
44
51
When the creation process finishes, the portal displays the editable knowledge base.
@@ -155,7 +162,7 @@ There are two main scenarios for batch testing:
155
162
***Process chat log files** - Determine the top answer for a previously unseen question - the most common situation is when you need to process are log file of queries, such as a chat bot's user questions. Create a batch file test, with only the required columns. The test returns the top answer for each question. That doesn't mean it the top answer is the correct answer. Once you complete this test, move on to the validation test.
156
163
***Validation test** - Validate the expected answer. This test requires that all the questions and matching expected answers in the batch test have been validated. This may require some manual process.
157
164
158
-
The following procedure assumes the scenario is to process chat logs with
165
+
The following procedure assumes the scenario is to process chat logs with
159
166
160
167
1. Create a new batch test file to include optional data, `batch-test-data-2.tsv`. Add the 6 rows from the original batch test input file, then add the metadata, top, and QnA set ID for each row.
0 commit comments