Skip to content

Commit b185b8f

Browse files
committed
few more edits
1 parent d643e6b commit b185b8f

File tree

4 files changed

+34
-23
lines changed

4 files changed

+34
-23
lines changed

articles/machine-learning/how-to-responsible-ai-text-dashboard.md

Lines changed: 34 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -71,8 +71,7 @@ To create a new cohort:
7171

7272
1. After you select and configure the filter, select **Add filter**. You can add several filters to define the cohort.
7373

74-
1. When you finish configuring and adding filters, select **Save** or **Save and switch** to finalize the new cohort.
75-
74+
1. When you're done adding filters, select **Save** or **Save and switch** to finish creating the cohort.
7675

7776
## RAI text dashboard components
7877

@@ -88,17 +87,18 @@ The following sections describe the Responsible AI text dashboard components and
8887

8988
### Error analysis
9089

91-
The **Error analysis** component helps you analyze failure patterns in your model. The default metric is **Error rate**. You can select a different metric from the **Select metric** dropdown list to learn more about your error and success nodes' performance. This metric selection doesn't impact the way your error tree is generated.
90+
The **Error analysis** component helps you analyze failure patterns in your model. You can select a metric from the **Select metric** dropdown list to learn more about your error and success nodes' performance. The default metric is **Error rate**. The metric selection doesn't impact the way your error tree is generated.
9291

9392
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis.png" alt-text="Screenshot of the error analysis component." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis.png":::
9493

95-
The right side of the **Error analysis** screen shows **Basic Information** about the current cohort and filters applied.
94+
The right side of the **Error analysis** screen shows information about the dataset, current selected cohort, and filters applied.
9695

96+
- **Basic Information** shows the name and filters applied for the current selected cohort.
9797
- **Instances in global cohort** displays the total number of points and the number of correctly and incorrectly predicted points in the entire dataset.
98-
- **Instances in the selected cohort** displays the total number of points and the number of correctly and incorrectly predicted points in the current cohort.
99-
- **Prediction path (filters)** lists the filters applied to the full dataset to create the current cohort.
98+
- **Instances in the selected cohort** displays the total number of points and the number of correctly and incorrectly predicted points in the currently selected cohort.
99+
- **Prediction path (filters)** lists the filters applied to the full dataset to create the currently selected cohort.
100100

101-
If you change the view by applying filters or selecting different features, you can save the view as a new cohort by selecting **Save as a new cohort**.
101+
If you change a view by applying filters or selecting different features, you can save the view as a new cohort by selecting **Save as a new cohort**.
102102

103103
You can view the error analysis component in **Tree map** or **Heat map** views by selecting either tab at the top of the component.
104104

@@ -110,12 +110,16 @@ The tree visualization uses the mutual information between each feature and the
110110

111111
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis-tree.png" alt-text="Screenshot of the tree map view in the error analysis component." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis-tree.png":::
112112

113-
In the tree view, each *node* represents a dataset cohort, potentially with filters applied, and shows the number of errors in that node compared to the total number of datapoints in the cohort. Hover over or select a node to display the **Error coverage**, or percentage of errors in the dataset that are in the selected node, and **Error rate**, the failure percentage of the datapoints in the selected node.
113+
In the tree view, each circle or *node* represents a dataset cohort, potentially with filters applied. The numbers in each node show the number of errors compared to the total number of datapoints in that node.
114+
115+
You can hover over or select a node to display the **Error coverage**, or percentage of errors in the dataset that are in that node, and **Error rate**, or failure percentage of the datapoints in the node. Nodes with darker background colors indicate higher error rates. Selected nodes have a heavy outline.
114116

115-
The *fill lines* between nodes visualize the distribution of datapoints into child cohorts based on filters, with the number of datapoints represented by line thickness. Hover over or select a fill line to display the feature and prediction being applied.
117+
The *fill lines* between nodes visualize the distribution of datapoints into child cohorts based on filters, with the number of datapoints represented by line thickness. You can hover over or select a fill line to display the feature and prediction being applied.
116118

117119
To find important failure patterns, look for nodes with darker colors indicating a higher error rate, and thicker fill lines indicating higher error coverage.
118120

121+
##### Feature list
122+
119123
To edit the list of features the tree uses to train the tree map, select **Feature list** at the top of the view.
120124

121125
In the **Feature list** pane, **Features** lists the names of the features in the dataset. You can search to find specific features. **Importances** visualizes the relative importance of each feature in the dataset. You can select or deselect the check boxes next to each feature to add or remove the feature from the tree map.
@@ -132,13 +136,13 @@ After you make changes in the **Feature list** pane, select **Apply** to apply t
132136

133137
#### Heat map view
134138

135-
You can use the **Heat map** view to focus on specific intersectional feature filters and compute disaggregated error rates. Start by comparing two dataset features to cluster and filter your data along the two dimensions. You can select one or many heatmap cells and create new cohorts.
139+
You can use the **Heat map** view to focus on specific intersectional feature filters and compute disaggregated error rates. Start by comparing two dataset features to cluster and filter your data along two dimensions. You can select one or many heatmap cells and create new cohorts.
136140

137141
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis-heat-map.png" alt-text="Screenshot of the error analysis component in the heat map." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/error-analysis-heat-map.png":::
138142

139143
In the **Heat map** view:
140144

141-
- **Cells** displays the number of cells selected. If no cells are selected, the view shows all cells with the same data as if all cells were selected.
145+
- **Cells** displays the number of cells selected. If no cells are selected, the view shows the data for all cells.
142146
- **Error coverage** displays the percentage of errors in the dataset that are in the selected cells.
143147
- **Error rate** displays the failure percentage of the datapoints in the selected cells.
144148

@@ -161,22 +165,29 @@ The **Model overview** component displays model and dataset statistics computed
161165

162166
You can choose between **Dataset cohorts** or **Feature cohorts** by selecting either tab at the top of the component. For either view, select **Metric(s)** from the dropdown list or select **Help me choose metrics** to open a sidebar screen that explains, recommends, and lets you select metrics to display.
163167

164-
For either view:
168+
You can also enable **Show heatmaps** for either view.
165169

166-
- You can enable **Show heatmaps**.
167170
- At the bottom of the component, you can choose to view **Metrics visualizations** or a **Confusion matrix**.
168171

169-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png" alt-text="Screenshot of the top part of the Model overview component." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png":::
172+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png" alt-text="Screenshot of a Confusion matrix in the Feature cohort view of the Model overview component." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png":::
173+
174+
#### Dataset cohorts and Feature cohorts
175+
176+
**Dataset cohorts** displays the selected metrics across the global cohort and all user-defined cohorts in the dashboard.
177+
178+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/model-overview.png" alt-text="Screenshot of the model overview on the dataset cohorts tab." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/model-overview.png":::
170179

171180
#### Dataset cohorts and Feature cohorts
172181

173-
- **Dataset cohorts** displays the selected metrics across the global cohort and all user-defined cohorts in the dashboard.
182+
**Feature cohorts** displays the selected metrics for cohorts that are based on selected features. You select the **Feature(s)** to define the cohorts. This view also shows **Fairness metrics** such as **Difference** and **Ratio** parity.
183+
184+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/model-overview-feature-cohort.png" alt-text="Screenshot of the model overview on the feature cohorts tab." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/model-overview-feature-cohort.png":::
174185

175-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/model-overview.png" alt-text="Screenshot of the model overview on the dataset cohorts tab." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/model-overview.png":::
186+
#### Metrics visualizations or Confusion matrix
176187

177-
- **Feature cohorts** displays the selected metrics for cohorts that are based on selected features. You select the **Feature(s)** to define the cohorts. This view also shows **Fairness metrics** such as **Difference** and **Ratio** parity.
188+
At the bottom of the component, you can choose to view **Metrics visualizations** or a **Confusion matrix**. The following example shows a confusion matrix for the **Feature cohorts** view.
178189

179-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/model-overview-feature-cohort.png" alt-text="Screenshot of the model overview on the feature cohorts tab." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/model-overview-feature-cohort.png":::
190+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png" alt-text="Screenshot of a Confusion matrix in the Feature cohort view of the Model overview component." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/confusion-matrix.png":::
180191

181192
### Data analysis
182193

@@ -190,22 +201,22 @@ The **Data analysis** component creates dataset cohorts to analyze dataset stati
190201

191202
#### Chart view
192203

193-
**Chart view** allows customized aggregate and local data exploration.
204+
**Chart view** lets you choose between customized aggregation and local data exploration.
194205

195206
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/data-analysis-chart-view.png" alt-text="Screenshot of data analysis on the chart view tab." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/data-analysis-chart-view.png":::
196207

197-
In the chart view, the X axis and Y axis show the values being plotted horizontally and vertically. You can select either label to open a sidebar pane to select and configure the axis.
208+
In the chart view, the X axis and Y axis show the values being plotted horizontally and vertically. You can select either label to open a sidebar pane to select and configure that axis.
198209

199210
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/axis-value.png" alt-text="Screenshot of the select your axis value sidebar.":::
200211

201212
In the **Select your axis value** pane, depending on the value, you can configure options such as **Apply binning to data**, **Enable logarithmic scaling**, or **Treat as categorical**. **Should dither** adds optional noise to the data to avoid overlapping points in the scatterplot.
202213

203214
Under **Chart type**, you can select whether to aggregate values across all datapoints.
204215

205-
- **Aggregate plot** displays data in bins or categories along the X-axis.
206-
- **Individual datapoints** shifts to a disaggregated view of the data.
216+
- **Aggregate plot** displays data in bins or categories along the X axis.
217+
- **Individual datapoints** displays a disaggregated view of the data.
207218

208-
In the **Individual datapoints** view, you can select the type of legend used to group datapoints. Selecting the label under **Color value** opens the **Select your axis value** sidebar with the same options that you use to create the chart axes.
219+
In the **Individual datapoints** view, you can select the type of legend used to group datapoints. Selecting the label under **Color value** opens the **Select your axis value** sidebar pane.
209220

210221
:::image type="content" source="./media/how-to-responsible-ai-dashboard-text-insights/data-analysis-chart-individual-datapoints.png" alt-text="Screenshot of data analysis on the chart view tab with individual datapoints option highlighted." lightbox="./media/how-to-responsible-ai-dashboard-text-insights/data-analysis-chart-individual-datapoints.png":::
211222

-67 Bytes
Loading
-158 Bytes
Loading
-30 Bytes
Loading

0 commit comments

Comments
 (0)