You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The dashboard offers a holistic assessment and debugging of models so you can make informed data-driven decisions. Having access to all of these tools in one interface empowers you to:
30
30
31
31
- Evaluate and debug your machine learning models by identifying model errors and fairness issues, diagnosing why those errors are happening, and informing your mitigation steps.
32
32
- Boost your data-driven decision-making abilities by addressing questions such as:
33
-
33
+
34
34
"What is the minimum change that users can apply to their features to get a different outcome from the model?"
35
-
35
+
36
36
"What is the causal effect of reducing or increasing a feature (for example, red meat consumption) on a real-world outcome (for example, diabetes progression)?"
37
37
38
38
You can customize the dashboard to include only the subset of tools that are relevant to your use case.
@@ -153,7 +153,7 @@ Need some inspiration? Here are some examples of how the dashboard's components
153
153
154
154
## People who should use the Responsible AI dashboard
155
155
156
-
The following people can use the Responsible AI dashboard, and its corresponding [Responsible AI scorecard](how-to-responsible-ai-scorecard.md), to build trust with AI systems:
156
+
The following people can use the Responsible AI dashboard, and its corresponding [Responsible AI scorecard](concept-responsible-ai-scorecard.md), to build trust with AI systems:
157
157
158
158
- Machine learning professionals and data scientists who are interested in debugging and improving their machine learning models before deployment
159
159
- Machine learning professionals and data scientists who are interested in sharing their model health records with product managers and business stakeholders to build trust and receive deployment permissions
@@ -175,4 +175,4 @@ The following people can use the Responsible AI dashboard, and its corresponding
175
175
## Next steps
176
176
177
177
- Learn how to generate the Responsible AI dashboard via [CLI and SDK](how-to-responsible-ai-dashboard-sdk-cli.md) or [Azure Machine Learning studio UI](how-to-responsible-ai-dashboard-ui.md).
178
-
- Learn how to generate a [Responsible AI scorecard](how-to-responsible-ai-scorecard.md) based on the insights observed on the Responsible AI dashboard.
178
+
- Learn how to generate a [Responsible AI scorecard](concept-responsible-ai-scorecard.md) based on the insights observed on the Responsible AI dashboard.
title: Share Responsible AI insights and make data-driven decisions with Azure Machine Learning Responsible AI scorecard
3
+
titleSuffix: Azure Machine Learning
4
+
description: Learn about how to use the Responsible AI scorecard to share responsible AI insights from your machine learning models and make data-driven decisions with non-technical and technical stakeholders.
5
+
services: machine-learning
6
+
ms.service: machine-learning
7
+
ms.subservice: enterprise-readiness
8
+
ms.topic: concept
9
+
ms.author: mesameki
10
+
author: mesameki
11
+
ms.reviewer: lagayhar
12
+
ms.date: 11/07/2022
13
+
ms.custom: responsible-ml
14
+
---
15
+
16
+
# Share Responsible AI insights using the Responsible AI scorecard (preview)
17
+
18
+
Our Responsible AI dashboard is designed for machine learning professionals and data scientists to explore and evaluate model insights and inform their data-driven decisions. While it can help you implement Responsible AI practically in your machine learning lifecycle, there are some needs left unaddressed:
19
+
20
+
- There often exists a gap between the technical Responsible AI tools (designed for machine-learning professionals) and the ethical, regulatory, and business requirements that define the production environment.
21
+
- While an end-to-end machine learning life cycle includes both technical and non-technical stakeholders in the loop, there's little support to enable an effective multi-stakeholder alignment, helping technical experts get timely feedback and direction from the non-technical stakeholders.
22
+
- AI regulations make it essential to be able to share model and data insights with auditors and risk officers for auditability purposes.
23
+
24
+
One of the biggest benefits of using the Azure Machine Learning ecosystem is related to the archival of model and data insights in the Azure Machine Learning Run History (for quick reference in future). As a part of that infrastructure and to accompany machine learning models and their corresponding Responsible AI dashboards, we introduce the Responsible AI scorecard to empower ML professionals to generate and share their data and model health records easily.
25
+
26
+
## Who should use a Responsible AI scorecard?
27
+
28
+
- If you're a data scientist or a machine learning professional, after training your model and generating its corresponding Responsible AI dashboard(s) for assessment and decision-making purposes, you can extract those learnings via our PDF scorecard and share the report easily with your technical and non-technical stakeholders to build trust and gain their approval for deployment.
29
+
30
+
- If you're a product manager, business leader, or an accountable stakeholder on an AI product, you can pass your desired model performance and fairness target values such as your target accuracy, target error rate, etc., to your data science team, asking them to generate this scorecard with respect to your identified target values and whether your model meets them. That can provide guidance into whether the model should be deployed or further improved.
31
+
32
+
## Next steps
33
+
34
+
- Learn how to generate the Responsible AI dashboard and scorecard via [CLI and SDK](how-to-responsible-ai-insights-sdk-cli.md) or [Azure Machine Learning studio UI](how-to-responsible-ai-insights-ui.md).
35
+
- Learn more about how the Responsible AI dashboard and scorecard in this [tech community blog post](https://techcommunity.microsoft.com/t5/ai-machine-learning-blog/responsible-ai-dashboard-and-scorecard-in-azure-machine-learning/ba-p/3391068).
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-responsible-ml.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.topic: conceptual
9
9
ms.author: mesameki
10
10
author: mesameki
11
11
ms.reviewer: lagayhar
12
-
ms.date: 08/05/2022
12
+
ms.date: 11/07/2022
13
13
ms.custom: responsible-ai, event-tier1-build-2022
14
14
#Customer intent: As a data scientist, I want to learn what Responsible AI is and how I can use it in Azure Machine Learning.
15
15
---
@@ -95,7 +95,7 @@ The people who design and deploy AI systems must be accountable for how their sy
95
95
- Notify and alert on events in the machine learning lifecycle. Examples include experiment completion, model registration, model deployment, and data drift detection.
96
96
- Monitor applications for operational issues and issues related to machine learning. Compare model inputs between training and inference, explore model-specific metrics, and provide monitoring and alerts on your machine learning infrastructure.
97
97
98
-
Besides the MLOps capabilities, the [Responsible AI scorecard](how-to-responsible-ai-scorecard.md) in Azure Machine Learning creates accountability by enabling cross-stakeholder communications. The scorecard also creates accountability by empowering developers to configure, download, and share their model health insights with their technical and non-technical stakeholders about AI data and model health. Sharing these insights can help build trust.
98
+
Besides the MLOps capabilities, the [Responsible AI scorecard](concept-responsible-ai-scorecard.md) in Azure Machine Learning creates accountability by enabling cross-stakeholder communications. The scorecard also creates accountability by empowering developers to configure, download, and share their model health insights with their technical and non-technical stakeholders about AI data and model health. Sharing these insights can help build trust.
99
99
100
100
The machine learning platform also enables decision-making by informing business decisions through:
101
101
@@ -106,5 +106,5 @@ The machine learning platform also enables decision-making by informing business
106
106
107
107
- For more information on how to implement Responsible AI in Azure Machine Learning, see [Responsible AI dashboard](concept-responsible-ai-dashboard.md).
108
108
- Learn how to generate the Responsible AI dashboard via [CLI and SDK](how-to-responsible-ai-dashboard-sdk-cli.md) or [Azure Machine Learning studio UI](how-to-responsible-ai-dashboard-ui.md).
109
-
- Learn how to generate a [Responsible AI scorecard](how-to-responsible-ai-scorecard.md) based on the insights observed in your Responsible AI dashboard.
109
+
- Learn how to generate a [Responsible AI scorecard](concept-responsible-ai-scorecard.md) based on the insights observed in your Responsible AI dashboard.
110
110
- Learn about the [Responsible AI Standard](https://blogs.microsoft.com/wp-content/uploads/prod/sites/5/2022/06/Microsoft-Responsible-AI-Standard-v2-General-Requirements-3.pdf) for building AI systems according to six key principles.
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-responsible-ai-dashboard-ui.md
+8-7Lines changed: 8 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,20 +1,21 @@
1
1
---
2
-
title: Generate a Responsible AI dashboard (preview) in the studio UI
2
+
title: Generate a Responsible AI insights in the studio UI
3
3
titleSuffix: Azure Machine Learning
4
-
description: Learn how to generate a Responsible AI dashboard with no-code experience in the Azure Machine Learning studio UI.
4
+
description: Learn how to generate a Responsible AI insights with no-code experience in the Azure Machine Learning studio UI.
5
5
services: machine-learning
6
6
ms.service: machine-learning
7
7
ms.subservice: enterprise-readiness
8
8
ms.topic: how-to
9
-
ms.author: lagayhar
10
-
author: lgayhardt
11
-
ms.date: 08/17/2022
9
+
ms.reviewer: lagayhar
10
+
ms.author: mithigpe
11
+
author: minthigpen
12
+
ms.date: 11/07/2022
12
13
ms.custom: responsible-ml, event-tier1-build-2022
13
14
---
14
15
15
-
# Generate a Responsible AI dashboard (preview) in the studio UI
16
+
# Generate a Responsible AI insights in the studio UI
16
17
17
-
In this article, you create a Responsible AI dashboard with a no-code experience in the [Azure Machine Learning studio UI](https://ml.azure.com/). To access the dashboard generation wizard, do the following:
18
+
In this article, you create a Responsible AI dashboard and scorecard (preview) with a no-code experience in the [Azure Machine Learning studio UI](https://ml.azure.com/). To access the dashboard generation wizard, do the following:
18
19
19
20
1.[Register your model](how-to-manage-models.md) in Azure Machine Learning so that you can access the no-code experience.
20
21
1. On the left pane of Azure Machine Learning studio, select the **Models** tab.
0 commit comments