Skip to content

Commit 87b134b

Browse files
committed
file names, toc, edits
1 parent bf9b135 commit 87b134b

8 files changed

+38
-21
lines changed

articles/machine-learning/.openpublishing.redirection.machine-learning.json

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3524,6 +3524,21 @@
35243524
"source_path_from_root": "/articles/machine-learning/how-to-troubleshoot-batch-endpoints.md",
35253525
"redirect_url": "/azure/machine-learning/batch-inference/how-to-troubleshoot-batch-endpoints",
35263526
"redirect_document_id": true
3527-
}
3527+
},
3528+
{
3529+
"source_path_from_root": "/articles/machine-learning/concept-responsible-ml.md",
3530+
"redirect_url": "/azure/machine-learning/batch-inference/concept-responsible-ai",
3531+
"redirect_document_id": true
3532+
},
3533+
{
3534+
"source_path_from_root": "/articles/machine-learning/how-to-responsible-ai-dashboard-ui.md",
3535+
"redirect_url": "/azure/machine-learning/batch-inference/how-to-responsible-ai-insights-ui",
3536+
"redirect_document_id": true
3537+
},
3538+
{
3539+
"source_path_from_root": "/articles/machine-learning/how-to-responsible-ai-dashboard-sdk-cli.md",
3540+
"redirect_url": "/azure/machine-learning/batch-inference/how-to-responsible-ai-insights-sdk-cli",
3541+
"redirect_document_id": true
3542+
},
35283543
]
35293544
}

articles/machine-learning/concept-responsible-ai-dashboard.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ The Responsible AI dashboard is accompanied by a [PDF scorecard](how-to-responsi
4343

4444
The Responsible AI dashboard brings together, in a comprehensive view, various new and pre-existing tools. The dashboard integrates these tools with [Azure Machine Learning CLI v2, Azure Machine Learning Python SDK v2](concept-v2.md), and [Azure Machine Learning studio](overview-what-is-azure-machine-learning.md#studio). The tools include:
4545

46-
- [Data explorer](concept-data-analysis.md), to understand and explore your dataset distributions and statistics.
46+
- [Data analysis](concept-data-analysis.md), to understand and explore your dataset distributions and statistics.
4747
- [Model overview and fairness assessment](concept-fairness-ml.md), to evaluate the performance of your model and evaluate your model's group fairness issues (how your model's predictions affect diverse groups of people).
4848
- [Error analysis](concept-error-analysis.md), to view and understand how errors are distributed in your dataset.
4949
- [Model interpretability](how-to-machine-learning-interpretability.md) (importance values for aggregate and individual features), to understand your model's predictions and how those overall and individual predictions are made.
@@ -83,7 +83,7 @@ The following table describes when to use Responsible AI dashboard components to
8383
| Identify | Error analysis | The error analysis component helps you get a deeper understanding of model failure distribution and quickly identify erroneous cohorts (subgroups) of data. <br><br> The capabilities of this component in the dashboard come from the [Error Analysis](https://erroranalysis.ai/) package.|
8484
| Identify | Fairness analysis | The fairness component defines groups in terms of sensitive attributes such as sex, race, and age. It then assesses how your model predictions affect these groups and how you can mitigate disparities. It evaluates the performance of your model by exploring the distribution of your prediction values and the values of your model performance metrics across the groups. <br><br>The capabilities of this component in the dashboard come from the [Fairlearn](https://fairlearn.org/) package. |
8585
| Identify | Model overview | The model overview component aggregates model assessment metrics in a high-level view of model prediction distribution for better investigation of its performance. This component also enables group fairness assessment by highlighting the breakdown of model performance across sensitive groups. |
86-
| Diagnose | Data explorer | The data explorer visualizes datasets based on predicted and actual outcomes, error groups, and specific features. You can then identify issues of overrepresentation and underrepresentation, along with seeing how data is clustered in the dataset. |
86+
| Diagnose | Data analysis | Data analysis visualizes datasets based on predicted and actual outcomes, error groups, and specific features. You can then identify issues of overrepresentation and underrepresentation, along with seeing how data is clustered in the dataset. |
8787
| Diagnose | Model interpretability | The interpretability component generates human-understandable explanations of the predictions of a machine learning model. It provides multiple views into a model's behavior: <br> - Global explanations (for example, which features affect the overall behavior of a loan allocation model) <br> - Local explanations (for example, why an applicant's loan application was approved or rejected) <br><br> The capabilities of this component in the dashboard come from the [InterpretML](https://interpret.ml/) package. |
8888
| Diagnose | Counterfactual analysis and what-if| This component consists of two functionalities for better error diagnosis: <br> - Generating a set of examples in which minimal changes to a particular point alter the model's prediction. That is, the examples show the closest data points with opposite model predictions. <br> - Enabling interactive and custom what-if perturbations for individual data points to understand how the model reacts to feature changes. <br> <br> The capabilities of this component in the dashboard come from the [DiCE](https://github.com/interpretml/DiCE) package. |
8989

@@ -108,7 +108,7 @@ Exploratory data analysis, causal inference, and counterfactual analysis capabil
108108

109109
These components of the Responsible AI dashboard support responsible decision-making:
110110

111-
- **Data explorer**: You can reuse the data explorer component here to understand data distributions and to identify overrepresentation and underrepresentation. Data exploration is a critical part of decision making, because it isn't feasible to make informed decisions about a cohort that's underrepresented in the data.
111+
- **Data analysis**: You can reuse the data analysis component here to understand data distributions and to identify overrepresentation and underrepresentation. Data exploration is a critical part of decision making, because it isn't feasible to make informed decisions about a cohort that's underrepresented in the data.
112112
- **Causal inference**: The causal inference component estimates how a real-world outcome changes in the presence of an intervention. It also helps construct promising interventions by simulating feature responses to various interventions and creating rules to determine which population cohorts would benefit from a particular intervention. Collectively, these functionalities allow you to apply new policies and effect real-world change.
113113

114114
The capabilities of this component come from the [EconML](https://github.com/Microsoft/EconML) package, which estimates heterogeneous treatment effects from observational data via machine learning.
@@ -142,14 +142,14 @@ Need some inspiration? Here are some examples of how the dashboard's components
142142

143143
| Responsible AI dashboard flow | Use case |
144144
|-------------------------------|----------|
145-
| Model overview > error analysis > data explorer | To identify model errors and diagnose them by understanding the underlying data distribution |
146-
| Model overview > fairness assessment > data explorer | To identify model fairness issues and diagnose them by understanding the underlying data distribution |
145+
| Model overview > error analysis > data analysis | To identify model errors and diagnose them by understanding the underlying data distribution |
146+
| Model overview > fairness assessment > data analysis | To identify model fairness issues and diagnose them by understanding the underlying data distribution |
147147
| Model overview > error analysis > counterfactuals analysis and what-if | To diagnose errors in individual instances with counterfactual analysis (minimum change to lead to a different model prediction) |
148-
| Model overview > data explorer | To understand the root cause of errors and fairness issues introduced via data imbalances or lack of representation of a particular data cohort |
148+
| Model overview > data analysis | To understand the root cause of errors and fairness issues introduced via data imbalances or lack of representation of a particular data cohort |
149149
| Model overview > interpretability | To diagnose model errors through understanding how the model has made its predictions |
150-
| Data explorer > causal inference | To distinguish between correlations and causations in the data or decide the best treatments to apply to get a positive outcome |
150+
| Data analysis > causal inference | To distinguish between correlations and causations in the data or decide the best treatments to apply to get a positive outcome |
151151
| Interpretability > causal inference | To learn whether the factors that the model has used for prediction-making have any causal effect on the real-world outcome|
152-
| Data explorer > counterfactuals analysis and what-if | To address customers' questions about what they can do next time to get a different outcome from an AI system|
152+
| Data analysis > counterfactuals analysis and what-if | To address customers' questions about what they can do next time to get a different outcome from an AI system|
153153

154154
## People who should use the Responsible AI dashboard
155155

File renamed without changes.

articles/machine-learning/how-to-responsible-ai-dashboard.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -168,7 +168,7 @@ Select the **Heat map** tab to switch to a different view of the error in the da
168168
5. **Cells**: Represents a cohort of the dataset, with filters applied, and the percentage of errors out of the total number of data points in the cohort. A blue outline indicates selected cells, and the darkness of red represents the concentration of failures.
169169
6. **Prediction path (filters)**: Lists the filters placed over the full dataset for each selected cohort.
170170

171-
### Model overview
171+
### Model overview and fairness metrics
172172

173173
The model overview component provides a comprehensive set of performance and fairness metrics for evaluating your model, along with key performance disparity metrics along specified features and dataset cohorts.
174174

@@ -219,7 +219,7 @@ With the data analysis component, the **Table view** pane shows you a table view
219219

220220
The **Chart view** panel shows you aggregate and individual plots of datapoints. You can analyze data statistics along the x-axis and y-axis by using filters such as predicted outcome, dataset features, and error groups. This view helps you understand overrepresentation and underrepresentation in your dataset.
221221

222-
:::image type="content" source="./media/how-to-responsible-ai-dashboard/data-analysis-table-view.png" alt-text="Screenshot of the dashboard, showing the data explorer." lightbox= "./media/how-to-responsible-ai-dashboard/data-analysis-table-view.png":::
222+
:::image type="content" source="./media/how-to-responsible-ai-dashboard/data-analysis-table-view.png" alt-text="Screenshot of the dashboard, showing the data analysis." lightbox= "./media/how-to-responsible-ai-dashboard/data-analysis-table-view.png":::
223223

224224
1. **Select a dataset cohort to explore**: Specify which dataset cohort from your list of cohorts you want to view data statistics for.
225225
2. **X-axis**: Displays the type of value being plotted horizontally. Modify the values by selecting the button to open a side panel.
@@ -228,7 +228,7 @@ The **Chart view** panel shows you aggregate and individual plots of datapoints.
228228

229229
By selecting the **Individual data points** option under **Chart type**, you can shift to a disaggregated view of the data with the availability of a color axis.
230230

231-
:::image type="content" source="./media/how-to-responsible-ai-dashboard/data-analysis-individual-datapoints.png" alt-text="Screenshot of the dashboard, showing the data explorer with the 'Individual data points' option selected." lightbox= "./media/how-to-responsible-ai-dashboard/data-analysis-individual-datapoints.png":::
231+
:::image type="content" source="./media/how-to-responsible-ai-dashboard/data-analysis-individual-datapoints.png" alt-text="Screenshot of the dashboard, showing the data analysis with the 'Individual data points' option selected." lightbox= "./media/how-to-responsible-ai-dashboard/data-analysis-individual-datapoints.png":::
232232

233233
### Feature importances (model explanations)
234234

File renamed without changes.

articles/machine-learning/how-to-responsible-ai-scorecard.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,9 +38,9 @@ The Responsible AI scorecard is a PDF summary of key insights from your Responsi
3838

3939
:::image type="content" source="./media/how-to-responsible-ai-scorecard/scorecard-summary.png" alt-text="Screenshot of the model summary on the Responsible AI scorecard PDF.":::
4040

41-
The data explorer segment shows you characteristics of your data, because any model story is incomplete without a correct understanding of your data:
41+
The data analysis segment shows you characteristics of your data, because any model story is incomplete without a correct understanding of your data:
4242

43-
:::image type="content" source="./media/how-to-responsible-ai-scorecard/scorecard-data-explorer.png" alt-text="Screenshot of the data explorer on the Responsible AI scorecard PDF.":::
43+
:::image type="content" source="./media/how-to-responsible-ai-scorecard/scorecard-data-explorer.png" alt-text="Screenshot of the data analysis on the Responsible AI scorecard PDF.":::
4444

4545
The model performance segment displays your model's most important metrics and characteristics of your predictions and how well they satisfy your desired target values:
4646

articles/machine-learning/toc.yml

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -172,11 +172,13 @@
172172
items:
173173
- name: Responsible AI overview
174174
displayName: responsible, ml
175-
href: concept-responsible-ml.md
175+
href: concept-responsible-ai.md
176176
- name: Implement Responsible AI in Practice
177177
items:
178178
- name: Responsible AI dashboard
179179
href: concept-responsible-ai-dashboard.md
180+
- name: Responsible AI scorecard
181+
href: concept-responsible-ai-scorecard.md
180182
- name: Model interpretability
181183
displayName: explainability, explanations, interpretability
182184
href: how-to-machine-learning-interpretability.md
@@ -658,18 +660,18 @@
658660
href: how-to-manage-resources-vscode.md
659661
- name: Implement Responsible AI in Practice
660662
items:
661-
- name: Generate Responsible AI dashboard
663+
- name: Generate Responsible AI insights
662664
items:
663-
- name: Responsible AI dashboard (V2)
665+
- name: Responsible AI insights (V2)
664666
displayName: explanations, interpretability, fairness, bias, model performance, disparity metrics, unfairness, causal analysis, causal inference, exploratory data analysis, EDA, dataset explorer
665-
href: how-to-responsible-ai-dashboard-sdk-cli.md
666-
- name: Responsible AI dashboard (UI)
667+
href: how-to-responsible-ai-insights-sdk-cli.md
668+
- name: Responsible AI insights (UI)
667669
displayName: explanations, interpretability, fairness, bias, model performance, disparity metrics, unfairness, causal analysis, causal inference, exploratory data analysis, EDA, dataset explorer
668-
href: how-to-responsible-ai-dashboard-ui.md
670+
href: how-to-responsible-ai-insights-ui.md
669671
- name: Using the Responsible AI dashboard in studio
670672
displayName: explanations, interpretability, fairness, bias, model performance, disparity metrics, unfairness, causal analysis, causal inference, exploratory data analysis, EDA, dataset explorer
671673
href: how-to-responsible-ai-dashboard.md
672-
- name: Responsible AI dashboard scorecard
674+
- name: Responsible AI scorecard in studio
673675
displayName: explanations, interpretability, fairness, bias, model performance, disparity metrics, unfairness, causal analysis, causal inference, exploratory data analysis, EDA, dataset explorer
674676
href: how-to-responsible-ai-scorecard.md
675677
- name: Troubleshoot & debug

0 commit comments

Comments
 (0)