You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The [Responsible AI (RAI) dashboard](concept-responsible-ai-dashboard.md) brings together several RAI tools in a single interface to help inform data-driven decisions about your models. Understanding natural language processing (NLP) models can be different from assessing tabular data. RAI dashboard debugging and visualizations now support text data.
20
+
The [Responsible AI (RAI) dashboard](concept-responsible-ai-dashboard.md) brings together several RAI tools in a single interface to help inform data-driven decisions about your models. Understanding natural language processing (NLP) models can be different from assessing tabular data. RAI dashboard model debugging and visualizations now support text data.
21
21
22
-
The Responsible AI text dashboard provides several mature RAI tools in the areas of error analysis, model interpretability, unfairness assessment, and mitigation. The dashboard supports a holistic assessment and debugging of NLP models for making informed business decisions.
22
+
The Responsible AI text dashboard provides several mature RAI tools in the areas of error analysis, model interpretability, unfairness assessment, and mitigation. The dashboard supports holistic assessment and debugging of NLP models to aid in making informed business decisions.
23
23
24
-
This article describes how the Responsible AI text insights component generates a Responsible AI text dashboard by using a pipeline job. The following sections provide specifications and requirements for the text insights component and example code snippets in YAML and Python.
24
+
This article describes the Responsible AI text insights component and how to use it in a pipeline job to generate a Responsible AI text dashboard. The following sections provide specifications and requirements for the text insights component and example code snippets in YAML and Python.
25
25
26
26
> [!IMPORTANT]
27
27
> The Responsible AI text dashboard is currently in public preview. This preview is provided without a service-level agreement, and isn't recommended for production workloads. Certain features might not be supported or might have constrained capabilities. For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
@@ -34,30 +34,30 @@ The Azure Machine Learning Responsible AI text insights component assembles gene
34
34
35
35
- All models must be registered in Azure Machine Learning.
36
36
- MLflow models with a sklearn (scikit-learn) or PyTorch flavor and HuggingFace models are supported.
37
-
- The training and test dataset inputs must be in mltable format.
38
-
-For performance reason, the test dataset is restricted to 5,000 rows of the visualization UI.
37
+
- The training and test dataset inputs must be in `mltable` format.
38
+
-The test dataset is restricted to 5,000 rows of the visualization UI, for performance reasons.
39
39
40
40
### Parameters
41
41
42
-
The Responsible AI text insights `task_type` parameter supports the following scenarios:
42
+
The Responsible AI text insights component supports the following scenarios through the `task_type` parameter:
| Text Classification |Predict classes for the given text content |`task_type="text_classification"`|
47
-
| Multi-label Text Classification |Predict multiple classes for the given text content |`task_type="multilabel_text_classification"`|
48
-
| Text Question Answering |Evaluate a question answering model on the text dataset |`task_type="question_answering"`|
46
+
| Text Classification |Predicts classes for the given text content |`task_type="text_classification"`|
47
+
| Multi-label Text Classification |Predicts multiple classes for the given text content |`task_type="multilabel_text_classification"`|
48
+
| Text Question Answering |Evaluates a question answering model on the text dataset |`task_type="question_answering"`|
49
49
50
-
The Responsible AI text insights component accepts the following other parameters:
50
+
The component accepts the following optional parameters:
51
51
52
52
| Parameter name | Description | Type |
53
53
|----------------|-------------|------|
54
-
|`title`|(Optional) Brief description of the dashboard. | String |
55
-
|`classes`|(Optional) The full list of class labels in the training dataset. | List of strings |
56
-
|`maximum_rows_for_test_dataset`|(Optional) The maximum number of rows allowed in the test dataset, for performance reasons. Defaults to 5,000. | Integer |
54
+
|`title`| Brief description of the dashboard. | String |
55
+
|`classes`| The full list of class labels in the training dataset. | List of strings |
56
+
|`maximum_rows_for_test_dataset`| The maximum number of rows allowed in the test dataset. Defaults to 5,000. | Integer |
57
57
|`target_column_name`| The name of the column in the input datasets that the model is trying to predict. | String |
58
58
|`enable_explanation`| Enable generating an explanation for the model. | Boolean |
59
59
|`enable_error_analysis`| Enable generating an error analysis for the model. | Boolean|
60
-
|`use_model_dependency`| The Responsible AI environment doesn't include the model dependencies. When set to `True`, installs the model dependency packages. | Boolean |
60
+
|`use_model_dependency`| The Responsible AI environment doesn't include the model dependencies by default. When set to `True`, installs the model dependency packages. | Boolean |
61
61
|`use_conda`| Installs the model dependency packages using `conda` if set to `True`, otherwise uses `pip`. | Boolean |
62
62
63
63
### Ports
@@ -68,21 +68,22 @@ The Responsible AI text insights component has three major input ports:
68
68
- The training dataset
69
69
- The test dataset
70
70
71
-
The easiest way to supply the input model is to register the model and reference the same model in the `model_input` port of the Responsible AI text insights component.
72
-
73
-
The training and test datasets don't have to be, but can be the same dataset.
71
+
The training and test datasets don't have to be, but can be the same dataset. The easiest way to supply the model input is to register the model and reference the same model in the `model_input` port of the Responsible AI text insights component.
74
72
75
73
There are two output ports:
76
74
77
75
- The `dashboard` port contains the completed `RAITextInsights` object.
78
76
- The `ux_json` port contains the data required to display a minimal dashboard.
79
77
78
+
### Pipeline job
79
+
80
+
To create the Responsible AI text dashboard, you can define the RAI components in a pipeline and submit the pipeline job.
81
+
80
82
# [YAML](#tab/yaml)
81
83
82
-
You can specify the pipeline as a YAML file, as in the following example, and submit it by using the Azure CLI command line.
84
+
You can specify the pipeline as a YAML file, as in the following example, and submit it by using the Azure CLI `az ml job create` command.
The Responsible AI text dashboard uses the [Responsible AI Text SDK for Python](https://github.com/microsoft/responsible-ai-toolbox/tree/main/responsibleai_text).
108
109
109
-
First, load the RAI component:
110
+
In your Python script, load the RAI text insights component:
0 commit comments