You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/examples.rst
+6-8Lines changed: 6 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,14 +1,13 @@
1
1
Examples
2
2
===========
3
-
Here you can find various conversational AI tasks as examples and can train multi-task models
4
-
in simple steps mentioned in the notebooks.
3
+
Here you can find various NLP (especially conversational AI) tasks as examples and can train them either in multi-task or single-task manner, using some simple steps mentioned in the notebooks.
5
4
6
5
Example-1 Intent detection, NER, Fragment detection
``Intent Detection`` :- This is a single sentence classification task where an `intent` specifies which class the data sample belongs to.
10
+
``Intent Detection`` :- This can be modeled as a single sentence classification task where an `intent` specifies which class the query belongs to.
12
11
13
12
``NER`` :- This is a Named Entity Recognition/ Sequence Labelling/ Slot filling task where individual words of the sentence are tagged with an entity label it belongs to. The words which don't belong to any entity label are simply labeled as "O".
14
13
@@ -18,7 +17,7 @@ Example-1 Intent detection, NER, Fragment detection
18
17
19
18
NER helps in extracting values for required entities (eg. location, date-time) from query.
20
19
21
-
Fragment detection is a very useful piece in conversational system as knowing if a query/sentence is incomplete can aid in discarding bad queries beforehand.
20
+
Fragment detection is a very useful piece in conversational system as knowing if a query/sentence is incomplete can aid in recognising ill-formed , incomplete user queries and apprpriate expanded options can be provided to the user .
22
21
23
22
**Data** :- In this example, we are using the `SNIPS <https://snips-nlu.readthedocs.io/en/latest/dataset.html>`_ data for intent and entity detection. For the sake of simplicity, we provide
24
23
the data in simpler form under ``snips_data`` directory taken from `here <https://github.com/LeePleased/StackPropagation-SLU/tree/master/data/snips>`_.
@@ -29,15 +28,14 @@ the data in simpler form under ``snips_data`` directory taken from `here <https:
``Entailment`` :- This is a sentence pair classification task which determines whether the second sentence in a sample can be inferred from the first.
36
+
``Entailment`` :- This is a sentence pair classification task . Given two text instances ‘premise’ and ‘Hypothesis’, Textual Entailment Recognition is the task of determining whether the hypothesis is entailed (can be inferred) from the premise or not.
38
37
39
-
**Conversational Utility** :- In conversational AI context, this task can be seen as determining whether the second sentence is similar to first or not.
40
-
Additionally, the probability score can also be used as a similarity score between the sentences.
38
+
**Conversational Utility** :- it can be used for evaluating pairwise similarity between queries , also to determine if a query is out-of-context or adversarial in conversational AI usecases like FAQ question answering.
41
39
42
40
**Data** :- In this example, we are using the `SNLI <https://nlp.stanford.edu/projects/snli>`_ data which is having sentence pairs and labels.
0 commit comments