You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-responsible-ai-image-dashboard.md
+19-23Lines changed: 19 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -33,13 +33,13 @@ Responsible AI image dashboards are linked to your registered computer vision mo
33
33
-[YAML and Python via a pipeline job](how-to-responsible-ai-insights-sdk-cli.md)
34
34
- A preconfigured sample Jupyter notebook like [Image Classification scenario with RAI Dashboard](https://github.com/Azure/azureml-examples/blob/main/sdk/python/responsible-ai/vision/responsibleaidashboard-image-classification-fridge.ipynb) or [Object Detection scenario with RAI Dashboard](https://github.com/Azure/azureml-examples/blob/main/sdk/python/responsible-ai/vision/responsibleaidashboard-automl-object-detection-fridge-private-data.ipynb).
35
35
36
-
Some features of the RAI image dashboard require dynamic, on-the-fly, and real-time computation. For complete functionality, you need to connect a running compute resource to your dashboard. For more information, see [Enable full functionality of the Responsible AI dashboard](how-to-responsible-ai-dashboard.md#enable-full-functionality-of-the-responsible-ai-dashboard).
37
-
38
-
An integrated compute resource enables full functionality of the image scenarios. For example:
36
+
Some features of the RAI image dashboard require dynamic, on-the-fly, and real-time computation. For example:
39
37
40
38
- For object detection, setting an Intersection over Union (IOU) threshold is disabled by default, and is enabled only if a compute resource is attached.
41
39
- When you submit a Distributed Parallel Version 2 (DPv2) job, attaching a compute resource enables precomputing of all model explanations instead of loading explanations on-demand.
42
40
41
+
For complete functionality of the image scenarios, you need to connect a running compute resource to your dashboard. For more information, see [Enable full functionality of the Responsible AI dashboard](how-to-responsible-ai-dashboard.md#enable-full-functionality-of-the-responsible-ai-dashboard).
42
+
43
43
To open the Responsible AI image dashboard in Machine Learning studio, select your registered model in the **Models** list, select **Responsible AI** at the top of the model page, and then select the name of your Responsible AI image dashboard from the list.
44
44
45
45
## Cohorts
@@ -164,18 +164,18 @@ Images display by label and show the distribution of each label in the dataset.
164
164
165
165
# [Image classification](#tab/classification)
166
166
167
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png" alt-text=" Screenshot of vision data explorer on the class view tab for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png":::
168
-
169
167
- Under **Select label type**, choose to view images by the predicted or ground truth label.
170
168
- Under **Select labels to display**, choose one or more class labels to view image instances containing those labels.
171
169
172
-
# [Object detection](#tab/detection)
170
+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png" alt-text=" Screenshot of vision data explorer on the class view tab for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png":::
173
171
174
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png" alt-text=" Screenshot of vision data explorer on the class view tab for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png":::
172
+
# [Object detection](#tab/detection)
175
173
176
174
- Under **Select label type**, choose to view images by correct or incorrect predictions.
177
175
- Under **Select labels to display**, choose one or more class labels to view image instances containing those labels.
178
176
177
+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png" alt-text=" Screenshot of vision data explorer on the class view tab for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png":::
178
+
179
179
---
180
180
181
181
### Model overview
@@ -229,16 +229,8 @@ In the **Feature cohorts** view, you can investigate your model by comparing mod
229
229
230
230
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-multiclass.png" alt-text="Screenshot of feature cohorts for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-multiclass.png":::
231
231
232
-
# [Object detection](#tab/detection)
233
-
234
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png" alt-text="Screenshot of feature cohorts for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png":::
235
-
236
-
---
237
-
238
232
#### Visualizations
239
233
240
-
# [Image classification](#tab/classification)
241
-
242
234
In the lower half of the **Dataset cohorts** view, you can select between the following visualizations:
243
235
244
236
-**Metrics visualizations** showing a bar graph that compares aggregated performance metrics across selected dataset cohorts.
@@ -253,6 +245,10 @@ In the lower half of the **Dataset cohorts** view, you can select between the fo
253
245
254
246
# [Object detection](#tab/detection)
255
247
248
+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png" alt-text="Screenshot of feature cohorts for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png":::
249
+
250
+
#### Visualizations
251
+
256
252
In the lower half of the **Dataset cohorts** view, **Metrics visualizations** shows a bar graph that compares aggregated performance metrics across selected dataset cohorts.
257
253
258
254
- Select **Choose cohorts** to open a sidebar that lets you select the dataset and feature cohorts to apply.
@@ -268,14 +264,16 @@ The **Data analysis** component creates dataset cohorts to analyze dataset stati
268
264
269
265
#### Table view
270
266
271
-
**Table view** shows true and predicted values and the tabular extracted features.
272
-
273
267
# [Image classification](#tab/classification)
274
268
269
+
**Table view** shows true and predicted values and the tabular extracted features.
270
+
275
271
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png" alt-text="Screenshot of data analysis on the Table view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png":::
276
272
277
273
# [Object detection](#tab/detection)
278
274
275
+
**Table view** shows correct and incorrect values and the tabular extracted features.
276
+
279
277
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-object.png" alt-text="Screenshot of data analysis on the Table view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-object.png":::
280
278
281
279
---
@@ -284,8 +282,6 @@ The **Data analysis** component creates dataset cohorts to analyze dataset stati
284
282
285
283
**Chart view** lets you choose between customized aggregation and local data exploration.
286
284
287
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-view.png" alt-text="Screenshot of data analysis on the chart view tab." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-view.png":::
288
-
289
285
In the chart view, the X axis and Y axis show the values being plotted horizontally and vertically. You can select either label to open a sidebar pane to select and configure that axis.
290
286
291
287
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/axis-value.png" alt-text="Screenshot of the select your axis value sidebar.":::
@@ -303,13 +299,13 @@ Under **Chart type**, you can select whether to aggregate values across all data
303
299
304
300
Scatter chart for image classification:
305
301
306
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png" alt-text="Screenshot of disaggregated data analysis on the Chart view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png":::
302
+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png" alt-text="Screenshot of disaggregated data analysis on the Chart view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-class.png":::
307
303
308
304
# [Object detection](#tab/detection)
309
305
310
306
Aggregate chart for object detection:
311
307
312
-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png" alt-text="Screenshot of aggregated data analysis on the Chart view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png":::
308
+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-aggregate-object.png" alt-text="Screenshot of aggregated data analysis on the Chart view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-aggregate-object.png":::
313
309
314
310
---
315
311
@@ -322,10 +318,10 @@ For AutoML image classification models, four kinds of explainability methods are
The explanations are generated only for the predicted class. For multilabel classification, a threshold on confidence score is required to select the classes to generate explanations for. See the [parameter list](how-to-responsible-ai-vision-insights.md#responsible-ai-vision-insights-component-parameter-automl-specific) for the parameter name.
326
-
327
321
These four methods are specific to AutoML image classification only, and don't work with other task types such as object detection and instance segmentation. Non-AutoML image classification models can use SHAP vision for model interpretability. Both AutoML and non-AutoML object detection models can use [D-RISE](https://github.com/microsoft/vision-explanation-methods) to generate visual explanations for model predictions.
328
322
323
+
The explanations are generated only for the predicted class. For multilabel classification, a threshold on confidence score is required to select the classes to generate explanations for. See the [parameter list](how-to-responsible-ai-vision-insights.md#responsible-ai-vision-insights-component-parameter-automl-specific) for the parameter name.
324
+
329
325
To learn more about the four explainability methods, see [Generate explanations for predictions](how-to-auto-train-image-models.md#generate-explanations-for-predictions). For more information about vision model interpretability techniques and how to interpret visual explanations of model behavior, see [Model interpretability](how-to-machine-learning-interpretability.md).
0 commit comments