Skip to content

Commit 6725806

Browse files
committed
fix
1 parent e9b7645 commit 6725806

File tree

3 files changed

+19
-23
lines changed

3 files changed

+19
-23
lines changed

articles/machine-learning/how-to-responsible-ai-image-dashboard.md

Lines changed: 19 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -33,13 +33,13 @@ Responsible AI image dashboards are linked to your registered computer vision mo
3333
- [YAML and Python via a pipeline job](how-to-responsible-ai-insights-sdk-cli.md)
3434
- A preconfigured sample Jupyter notebook like [Image Classification scenario with RAI Dashboard](https://github.com/Azure/azureml-examples/blob/main/sdk/python/responsible-ai/vision/responsibleaidashboard-image-classification-fridge.ipynb) or [Object Detection scenario with RAI Dashboard](https://github.com/Azure/azureml-examples/blob/main/sdk/python/responsible-ai/vision/responsibleaidashboard-automl-object-detection-fridge-private-data.ipynb).
3535

36-
Some features of the RAI image dashboard require dynamic, on-the-fly, and real-time computation. For complete functionality, you need to connect a running compute resource to your dashboard. For more information, see [Enable full functionality of the Responsible AI dashboard](how-to-responsible-ai-dashboard.md#enable-full-functionality-of-the-responsible-ai-dashboard).
37-
38-
An integrated compute resource enables full functionality of the image scenarios. For example:
36+
Some features of the RAI image dashboard require dynamic, on-the-fly, and real-time computation. For example:
3937

4038
- For object detection, setting an Intersection over Union (IOU) threshold is disabled by default, and is enabled only if a compute resource is attached.
4139
- When you submit a Distributed Parallel Version 2 (DPv2) job, attaching a compute resource enables precomputing of all model explanations instead of loading explanations on-demand.
4240

41+
For complete functionality of the image scenarios, you need to connect a running compute resource to your dashboard. For more information, see [Enable full functionality of the Responsible AI dashboard](how-to-responsible-ai-dashboard.md#enable-full-functionality-of-the-responsible-ai-dashboard).
42+
4343
To open the Responsible AI image dashboard in Machine Learning studio, select your registered model in the **Models** list, select **Responsible AI** at the top of the model page, and then select the name of your Responsible AI image dashboard from the list.
4444

4545
## Cohorts
@@ -164,18 +164,18 @@ Images display by label and show the distribution of each label in the dataset.
164164

165165
# [Image classification](#tab/classification)
166166

167-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png" alt-text=" Screenshot of vision data explorer on the class view tab for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png":::
168-
169167
- Under **Select label type**, choose to view images by the predicted or ground truth label.
170168
- Under **Select labels to display**, choose one or more class labels to view image instances containing those labels.
171169

172-
# [Object detection](#tab/detection)
170+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png" alt-text=" Screenshot of vision data explorer on the class view tab for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-multiclass.png":::
173171

174-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png" alt-text=" Screenshot of vision data explorer on the class view tab for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png":::
172+
# [Object detection](#tab/detection)
175173

176174
- Under **Select label type**, choose to view images by correct or incorrect predictions.
177175
- Under **Select labels to display**, choose one or more class labels to view image instances containing those labels.
178176

177+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png" alt-text=" Screenshot of vision data explorer on the class view tab for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/class-view-object.png":::
178+
179179
---
180180

181181
### Model overview
@@ -229,16 +229,8 @@ In the **Feature cohorts** view, you can investigate your model by comparing mod
229229

230230
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-multiclass.png" alt-text="Screenshot of feature cohorts for multiclass classification." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-multiclass.png":::
231231

232-
# [Object detection](#tab/detection)
233-
234-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png" alt-text="Screenshot of feature cohorts for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png":::
235-
236-
---
237-
238232
#### Visualizations
239233

240-
# [Image classification](#tab/classification)
241-
242234
In the lower half of the **Dataset cohorts** view, you can select between the following visualizations:
243235

244236
- **Metrics visualizations** showing a bar graph that compares aggregated performance metrics across selected dataset cohorts.
@@ -253,6 +245,10 @@ In the lower half of the **Dataset cohorts** view, you can select between the fo
253245

254246
# [Object detection](#tab/detection)
255247

248+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png" alt-text="Screenshot of feature cohorts for object detection." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/feature-cohorts-object.png":::
249+
250+
#### Visualizations
251+
256252
In the lower half of the **Dataset cohorts** view, **Metrics visualizations** shows a bar graph that compares aggregated performance metrics across selected dataset cohorts.
257253

258254
- Select **Choose cohorts** to open a sidebar that lets you select the dataset and feature cohorts to apply.
@@ -268,14 +264,16 @@ The **Data analysis** component creates dataset cohorts to analyze dataset stati
268264

269265
#### Table view
270266

271-
**Table view** shows true and predicted values and the tabular extracted features.
272-
273267
# [Image classification](#tab/classification)
274268

269+
**Table view** shows true and predicted values and the tabular extracted features.
270+
275271
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png" alt-text="Screenshot of data analysis on the Table view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png":::
276272

277273
# [Object detection](#tab/detection)
278274

275+
**Table view** shows correct and incorrect values and the tabular extracted features.
276+
279277
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-object.png" alt-text="Screenshot of data analysis on the Table view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-object.png":::
280278

281279
---
@@ -284,8 +282,6 @@ The **Data analysis** component creates dataset cohorts to analyze dataset stati
284282

285283
**Chart view** lets you choose between customized aggregation and local data exploration.
286284

287-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-view.png" alt-text="Screenshot of data analysis on the chart view tab." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-view.png":::
288-
289285
In the chart view, the X axis and Y axis show the values being plotted horizontally and vertically. You can select either label to open a sidebar pane to select and configure that axis.
290286

291287
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/axis-value.png" alt-text="Screenshot of the select your axis value sidebar.":::
@@ -303,13 +299,13 @@ Under **Chart type**, you can select whether to aggregate values across all data
303299

304300
Scatter chart for image classification:
305301

306-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png" alt-text="Screenshot of disaggregated data analysis on the Chart view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png":::
302+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-object.png" alt-text="Screenshot of disaggregated data analysis on the Chart view tab for image classification models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-scatter-class.png":::
307303

308304
# [Object detection](#tab/detection)
309305

310306
Aggregate chart for object detection:
311307

312-
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png" alt-text="Screenshot of aggregated data analysis on the Chart view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-table-class.png":::
308+
:::image type="content" source="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-aggregate-object.png" alt-text="Screenshot of aggregated data analysis on the Chart view tab for object detection models." lightbox="./media/how-to-responsible-ai-dashboard-vision-insights/data-analysis-chart-aggregate-object.png":::
313309

314310
---
315311

@@ -322,10 +318,10 @@ For AutoML image classification models, four kinds of explainability methods are
322318
- [Integrated Gradients](https://arxiv.org/abs/1703.01365)
323319
- [XRAI](https://arxiv.org/abs/1906.02825)
324320

325-
The explanations are generated only for the predicted class. For multilabel classification, a threshold on confidence score is required to select the classes to generate explanations for. See the [parameter list](how-to-responsible-ai-vision-insights.md#responsible-ai-vision-insights-component-parameter-automl-specific) for the parameter name.
326-
327321
These four methods are specific to AutoML image classification only, and don't work with other task types such as object detection and instance segmentation. Non-AutoML image classification models can use SHAP vision for model interpretability. Both AutoML and non-AutoML object detection models can use [D-RISE](https://github.com/microsoft/vision-explanation-methods) to generate visual explanations for model predictions.
328322

323+
The explanations are generated only for the predicted class. For multilabel classification, a threshold on confidence score is required to select the classes to generate explanations for. See the [parameter list](how-to-responsible-ai-vision-insights.md#responsible-ai-vision-insights-component-parameter-automl-specific) for the parameter name.
324+
329325
To learn more about the four explainability methods, see [Generate explanations for predictions](how-to-auto-train-image-models.md#generate-explanations-for-predictions). For more information about vision model interpretability techniques and how to interpret visual explanations of model behavior, see [Model interpretability](how-to-machine-learning-interpretability.md).
330326

331327
## Related content
10.2 KB
Loading

0 commit comments

Comments
 (0)