Skip to content

Commit 4920a76

Browse files
committed
touchup
1 parent c36d773 commit 4920a76

File tree

1 file changed

+14
-15
lines changed

1 file changed

+14
-15
lines changed

articles/machine-learning/how-to-responsible-ai-vision-insights.md

Lines changed: 14 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -36,10 +36,10 @@ The core component for constructing the Responsible AI image dashboard in Azure
3636
- MLflow models with PyTorch flavor and HuggingFace models are supported.
3737
- The dataset inputs must be in `mltable` format.
3838
- The test dataset is restricted to 5,000 rows of the visualization UI, for performance reasons.
39-
- Complex objects, such as lists of column names, must be supplied as single JSON-encoded strings to the RAI vision insights component.
39+
- Complex objects, such as lists of column names, must be supplied as single JSON-encoded strings.
4040
- Hierarchical cohort naming or creating a new cohort from a subset of an existing cohort, and adding images to an existing cohort, aren't supported.
4141
- `Guided_gradcam` doesn't work with vision-transformer models.
42-
- SHapley Additive ExPlanations (SHAP) isn't supported for AutoML computer vision models.
42+
- SHapley Additive ExPlanations (SHAP) isn't supported for [AutoML computer vision models](#integration-with-automl-image-classification).
4343
<!-- - IOU threshold values can't be changed. The current default value is 50%. -->
4444

4545
### Parameters
@@ -76,6 +76,12 @@ To start, register your input model in Azure Machine Learning and reference the
7676

7777
To generate RAI image dashboard model-debugging insights like model performance, data explorer, and model interpretability, and populate visualizations, use the same training and test datasets as for training your model. The datasets should be in `mltable` format and don't have to be, but can be the same dataset.
7878

79+
The following example shows the dataset schema for the image classification task type:
80+
81+
```python
82+
DataFrame({ 'image_path_1' : 'label_1', 'image_path_2' : 'label_2' ... })
83+
```
84+
7985
The following example shows the dataset schema for the object detection task type:
8086

8187
```python
@@ -92,20 +98,14 @@ DataFrame({
9298
})
9399
```
94100

95-
The following example shows the dataset schema for the image classification task type:
96-
97-
```python
98-
DataFrame({ 'image_path_1' : 'label_1', 'image_path_2' : 'label_2' ... })
99-
```
100-
101101
The component assembles the generated insights into a single Responsible AI image dashboard. There are two output ports:
102102

103103
- The `insights_pipeline_job.outputs.dashboard` port contains the completed `RAIVisionInsights` object.
104104
- The `insights_pipeline_job.outputs.ux_json` port contains the data required to display a minimal dashboard.
105105

106106
### Pipeline job
107107

108-
To create the Responsible AI image dashboard, you can define the RAI components in a pipeline and submit the pipeline job.
108+
To create the Responsible AI image dashboard, define the RAI components in a pipeline and submit the pipeline job.
109109

110110
# [YAML](#tab/yaml)
111111

@@ -132,6 +132,8 @@ You can specify the pipeline in a YAML file, as in the following example.
132132
enable_error_analysis: True
133133
```
134134
135+
You can submit the pipeline by using the Azure CLI `az ml job create` command.
136+
135137
# [Python SDK](#tab/python)
136138

137139
The Responsible AI image dashboard uses the [Responsible AI Vision SDK for Python](https://github.com/microsoft/responsible-ai-toolbox/tree/main/responsibleai_vision).
@@ -166,13 +168,10 @@ And assemble the output:
166168
rai_image_job.outputs.ux_json.mode = "upload"
167169
```
168170

171+
To learn how to submit the pipeline by using the Python SDK, see the [AutoML Image Classification scenario with RAI Dashboard sample notebook](https://github.com/Azure/azureml-examples/tree/main/sdk/python/responsible-ai).
169172
---
170173

171-
You can submit the RAI vision insights pipeline through one of the following methods:
172-
173-
- **Azure CLI:** You can submit the pipeline by using the Azure CLI `az ml job create` command.
174-
- **Python SDK:** To learn how to submit the pipeline through Python, see the [AutoML Image Classification scenario with RAI Dashboard sample notebook](https://github.com/Azure/azureml-examples/tree/main/sdk/python/responsible-ai).
175-
- **Azure Machine Learning studio UI**: You can use the RAI-vision insights component to [create and submit a pipeline from the Designer in Azure Machine Learning studio](how-to-create-component-pipelines-ui.md).
174+
You can also use the **Designer** UI in Azure Machine Learning studio to [create and submit a RAI-vision insights component pipeline](how-to-create-component-pipelines-ui.md).
176175

177176
After you specify and submit the pipeline and it executes, the dashboard should appear in the Machine Learning studio in the registered model view.
178177

@@ -182,7 +181,7 @@ Automated ML in Azure Machine Learning supports model training for computer visi
182181

183182
To generate Responsible AI insights for AutoML computer vision models, register your best AutoML model in the Azure Machine Learning workspace and run it through the Responsible AI vision insights pipeline. For more information, see [Set up AutoML to train computer vision models](how-to-auto-train-image-models.md).
184183

185-
For notebooks related to AutoML supported computer vision tasks, see [azureml-examples](https://github.com/Azure/azureml-examples/tree/main/sdk/python/jobs/automl-standalone-jobs).
184+
For notebooks related to AutoML supported computer vision tasks, see [RAI vision dashboard and scorecard notebooks](https://github.com/Azure/azureml-examples/tree/main/sdk/python/responsible-ai/vision#directory-) and [automl-standalone-jobs](https://github.com/Azure/azureml-examples/tree/main/sdk/python/jobs/automl-standalone-jobs).
186185

187186
### AutoML-specific RAI vision insights parameters
188187
<a name="responsible-ai-vision-insights-component-parameter-automl-specific"></a>

0 commit comments

Comments
 (0)