Skip to content

Commit f7d709d

Browse files
authored
Merge pull request #178824 from cjgronlund/kw
KW optimization
2 parents f6bd1f9 + 537daf8 commit f7d709d

7 files changed

+69
-60
lines changed

articles/machine-learning/concept-differential-privacy.md

Lines changed: 12 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,27 +1,27 @@
11
---
22
title: Differential privacy in machine learning (preview)
33
titleSuffix: Azure Machine Learning
4-
description: Learn what differential privacy is and how you can implement differentially private systems that preserve data privacy.
4+
description: Learn what differential privacy is and how differentially private systems preserve data privacy.
55
author: luisquintanilla
66
ms.author: luquinta
77
ms.date: 10/21/2021
88
services: machine-learning
99
ms.service: machine-learning
1010
ms.subservice: enterprise-readiness
1111
ms.topic: conceptual
12-
ms.custom: responsible-ml
12+
ms.custom: responsible-ml, mktng-kw-nov2021
1313
#Customer intent: As a data scientist, I want to know what differential privacy is and how I can implement a differentially private systems.
1414
---
1515

16-
# What is differential privacy in machine learning (preview)
16+
# What is differential privacy in machine learning (preview)?
1717

1818
Learn about differential privacy in machine learning and how it works.
1919

20-
As the amount of data that an organization collects and uses for analyses increases, so do concerns of privacy and security. Analyses require data. Typically, the more data used to train models, the more accurate they are. When personal information is used for these analyses, it's especially important that the data remains private throughout its use.
20+
As the amount of data that an organization collects and uses for analyses increases, so do concerns of privacy and security. Analyses require data. Typically, the more data used to train machine learning models, the more accurate they are. When personal information is used for these analyses, it's especially important that the data remains private throughout its use.
2121

2222
## How differential privacy works
2323

24-
Differential privacy is a set of systems and practices that help keep the data of individuals safe and private.
24+
Differential privacy is a set of systems and practices that help keep the data of individuals safe and private. In machine learning solutions, differential privacy may be required for regulatory compliance.
2525

2626
> [!div class="mx-imgBorder"]
2727
> ![Differential privacy machine learning process](./media/concept-differential-privacy/differential-privacy-machine-learning.jpg)
@@ -32,9 +32,9 @@ In differentially private systems, data is shared through requests called **quer
3232

3333
## Differential privacy metrics
3434

35-
Differential privacy tries to protect against the possibility that a user can produce an indefinite number of reports to eventually reveal sensitive data. A value known as **epsilon** measures how noisy or private a report is. Epsilon has an inverse relationship to noise or privacy. The lower the epsilon, the more noisy (and private) the data is.
35+
Differential privacy tries to protect against the possibility that a user can produce an indefinite number of reports to eventually reveal sensitive data. A value known as **epsilon** measures how noisy, or private, a report is. Epsilon has an inverse relationship to noise or privacy. The lower the epsilon, the more noisy (and private) the data is.
3636

37-
Epsilon values are non-negative. Values below 1 provide full plausible deniability. Anything above 1 comes with a higher risk of exposure of the actual data. As you implement differentially private systems, you want to produce reports with epsilon values between 0 and 1.
37+
Epsilon values are non-negative. Values below 1 provide full plausible deniability. Anything above 1 comes with a higher risk of exposure of the actual data. As you implement machine learning solutions with differential privacy, you want to data with epsilon values between 0 and 1.
3838

3939
Another value directly correlated to epsilon is **delta**. Delta is a measure of the probability that a report is not fully private. The higher the delta, the higher the epsilon. Because these values are correlated, epsilon is used more often.
4040

@@ -48,7 +48,7 @@ Although the preservation of privacy should be the goal, there is a tradeoff whe
4848

4949
## Open-source differential privacy libraries
5050

51-
SmartNoise is an open-source project that contains different components for building global differentially private systems. SmartNoise is made up of the following top-level components:
51+
SmartNoise is an open-source project that contains components for building machine learning solutions with differential privacy. SmartNoise is made up of the following top-level components:
5252

5353
- SmartNoise Core library
5454
- SmartNoise SDK library
@@ -76,6 +76,8 @@ The system library provides the following tools and services for working with ta
7676

7777
## Next steps
7878

79-
[How to build a differentially private system](how-to-differential-privacy.md) in Azure Machine Learning.
79+
Learn more about differential privacy in machine learning:
8080

81-
To learn more about the components of SmartNoise, check out the GitHub repositories for [SmartNoise Core](https://github.com/opendifferentialprivacy/smartnoise-core), [SmartNoise SDK](https://github.com/opendifferentialprivacy/smartnoise-sdk), and [SmartNoise samples](https://github.com/opendifferentialprivacy/smartnoise-samples).
81+
- [How to build a differentially private system](how-to-differential-privacy.md) in Azure Machine Learning.
82+
83+
- To learn more about the components of SmartNoise, check out the GitHub repositories for [SmartNoise Core](https://github.com/opendifferentialprivacy/smartnoise-core), [SmartNoise SDK](https://github.com/opendifferentialprivacy/smartnoise-sdk), and [SmartNoise samples](https://github.com/opendifferentialprivacy/smartnoise-samples).

articles/machine-learning/concept-model-management-and-deployment.md

Lines changed: 10 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,20 @@
11
---
22
title: 'MLOps: ML model management'
33
titleSuffix: Azure Machine Learning
4-
description: 'Learn about model management with Azure Machine Learning (MLOps). Deploy, manage, track lineage and monitor your models to continuously improve them. '
4+
description: 'Learn about model management (MLOps) with Azure Machine Learning . Deploy, manage, track lineage and monitor your models to continuously improve them. '
55
services: machine-learning
66
ms.service: machine-learning
77
ms.subservice: mlops
88
ms.topic: conceptual
99
author: jpe316
1010
ms.author: jordane
11-
ms.date: 10/21/2021
12-
ms.custom: seodec18
11+
ms.custom: seodec18, mktng-kw-nov2021
12+
ms.date: 11/04/2021
1313
---
1414

1515
# MLOps: Model management, deployment, lineage, and monitoring with Azure Machine Learning
1616

17-
In this article, learn about how to use Azure Machine Learning to manage the lifecycle of your models. Azure Machine Learning uses a Machine Learning Operations (MLOps) approach. MLOps improves the quality and consistency of your machine learning solutions.
17+
In this article, learn about how do Machine Learning Operations (MLOps) in Azure Machine Learning to manage the lifecycle of your models. MLOps improves the quality and consistency of your machine learning solutions.
1818

1919
## What is MLOps?
2020

@@ -24,6 +24,8 @@ Machine Learning Operations (MLOps) is based on [DevOps](https://azure.microsoft
2424
* Faster deployment of models into production
2525
* Quality assurance and end-to-end lineage tracking
2626

27+
## MLOps in Azure Machine Learning
28+
2729
Azure Machine Learning provides the following MLOps capabilities:
2830

2931
- **Create reproducible ML pipelines**. Machine Learning pipelines allow you to define repeatable and reusable steps for your data preparation, training, and scoring processes.
@@ -35,6 +37,7 @@ Azure Machine Learning provides the following MLOps capabilities:
3537
- **Automate the end-to-end ML lifecycle with Azure Machine Learning and Azure Pipelines**. Using pipelines allows you to frequently update models, test new models, and continuously roll out new ML models alongside your other applications and services.
3638

3739
For more information on MLOps, see [Machine Learning DevOps (MLOps)](/azure/cloud-adoption-framework/ready/azure-best-practices/ai-machine-learning-mlops).
40+
3841
## Create reproducible ML pipelines
3942

4043
Use ML pipelines from Azure Machine Learning to stitch together all of the steps involved in your model training process.
@@ -136,7 +139,7 @@ For more information, see [Controlled rollout of ML models](how-to-deploy-azure-
136139

137140
Microsoft Power BI supports using machine learning models for data analytics. For more information, see [Azure Machine Learning integration in Power BI (preview)](/power-bi/service-machine-learning-integration).
138141

139-
## Capture the governance data required for capturing the end-to-end ML lifecycle
142+
## Capture the governance data required for MLOps
140143

141144
Azure ML gives you the capability to track the end-to-end audit trail of all of your ML assets by using metadata.
142145

@@ -190,8 +193,8 @@ The [Azure Machine Learning extension](https://marketplace.visualstudio.com/item
190193
For more information on using Azure Pipelines with Azure Machine Learning, see the following links:
191194

192195
* [Continuous integration and deployment of ML models with Azure Pipelines](/azure/devops/pipelines/targets/azure-machine-learning)
193-
* [Azure Machine Learning MLOps](https://aka.ms/mlops) repository.
194-
* [Azure Machine Learning MLOpsPython](https://github.com/Microsoft/MLOpspython) repository.
196+
* [Azure Machine Learning MLOps](https://aka.ms/mlops) repository
197+
* [Azure Machine Learning MLOpsPython](https://github.com/Microsoft/MLOpspython) repository
195198

196199
You can also use Azure Data Factory to create a data ingestion pipeline that prepares data for use with training. For more information, see [Data ingestion pipeline](how-to-cicd-data-ingestion.md).
197200

articles/machine-learning/concept-open-source.md

Lines changed: 17 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -8,28 +8,21 @@ ms.subservice: mlops
88
ms.topic: conceptual
99
author: luisquintanilla
1010
ms.author: luquinta
11-
ms.date: 10/21/2021
11+
ms.custom: mktng-kw-nov2021
12+
ms.date: 11/04/2021
1213
---
1314

14-
# Open-source integration with Azure Machine Learning projects
15+
# Use open-source machine learning libraries and platforms with Azure Machine Learning
1516

16-
You can train, deploy, and manage the end-to-end machine learning process in Azure Machine Learning by using open-source Python machine learning libraries and platforms. Use development tools, like Jupyter Notebooks and Visual Studio Code, to leverage your existing models and scripts in Azure Machine Learning.
17-
18-
In this article, learn more about these open-source libraries and platforms.
17+
In this article, learn about open-source Python machine learning libraries and platforms you can use with Azure Machine Learning. Train, deploy, and manage the end-to-end machine learning process using open source projects you prefer. Use development tools, like Jupyter Notebooks and Visual Studio Code, to leverage your existing models and scripts in Azure Machine Learning.
1918

2019
## Train open-source machine learning models
2120

22-
The machine learning training process involves the application of algorithms to your data in order to achieve a task or solve a problem. Depending on the problem, you may choose different algorithms that best fit the task and your data. For more information on the different branches of machine learning, see the [deep learning vs machine learning article](./concept-deep-learning-vs-machine-learning.md) and the [machine learning algorithm cheat sheet](algorithm-cheat-sheet.md).
23-
24-
### Preserve data privacy using differential privacy
25-
26-
To train a machine learning model, you need data. Sometimes that data is sensitive, and it's important to make sure that the data is secure and private. Differential privacy is a technique of preserving the confidentiality of information in a dataset. To learn more, see the article on [preserving data privacy](concept-differential-privacy.md).
27-
28-
Open-source differential privacy toolkits like [SmartNoise](https://github.com/opendifferentialprivacy/smartnoise-core-python) help you [preserve the privacy of data](how-to-differential-privacy.md) in Azure Machine Learning solutions.
21+
The machine learning training process involves the application of algorithms to your data in order to achieve a task or solve a problem. Depending on the problem, you may choose different algorithms that best fit the task and your data. For more information on what you can solve with machine learning, see the [deep learning vs machine learning article](./concept-deep-learning-vs-machine-learning.md) and the [machine learning algorithm cheat sheet](algorithm-cheat-sheet.md).
2922

3023
### Classical machine learning: scikit-learn
3124

32-
For training tasks involving classical machine learning algorithms tasks such classification, clustering, and regression you might use something like Scikit-learn. To learn how to train a flower classification model, see the [how to train with Scikit-learn article](how-to-train-scikit-learn.md).
25+
For training tasks involving classical machine learning algorithms tasks such classification, clustering, and regression you might use something like scikit-learn. To learn how to train a flower classification model, see the [how to train with scikit-learn article](how-to-train-scikit-learn.md).
3326

3427
### Neural networks: PyTorch, TensorFlow, Keras
3528

@@ -41,6 +34,8 @@ Open-source deep learning frameworks and how-to guides include:
4134
* [TensorFlow](https://github.com/tensorflow/tensorflow): [Recognize handwritten digits using TensorFlow](how-to-train-tensorflow.md)
4235
* [Keras](https://github.com/keras-team/keras): [Build a neural network to analyze images using Keras](how-to-train-keras.md)
4336

37+
### Transfer learning
38+
4439
Training a deep learning model from scratch often requires large amounts of time, data, and compute resources. You can shortcut the training process by using transfer learning. Transfer learning is a technique that applies knowledge gained from solving one problem to a different but related problem. This means you can take an existing model repurpose it. See the [deep learning vs machine learning article](concept-deep-learning-vs-machine-learning.md#what-is-transfer-learning) to learn more about transfer learning.
4540

4641
### Reinforcement learning: Ray RLLib
@@ -55,6 +50,14 @@ To learn how to use Ray RLLib with Azure Machine Learning, see the [how to train
5550

5651
Training a single or multiple models requires the visualization and inspection of desired metrics to make sure the model performs as expected. You can [use TensorBoard in Azure Machine Learning to track and visualize experiment metrics](./how-to-monitor-tensorboard.md)
5752

53+
## Responsible ML: Privacy and fairness
54+
55+
### Preserve data privacy with differential privacy
56+
57+
To train a machine learning model, you need data. Sometimes that data is sensitive, and it's important to make sure that the data is secure and private. Differential privacy is a technique of preserving the confidentiality of information in a dataset. To learn more, see the article on [preserving data privacy](concept-differential-privacy.md).
58+
59+
Open-source differential privacy toolkits like [SmartNoise](https://github.com/opendifferentialprivacy/smartnoise-core-python) help you [preserve the privacy of data](how-to-differential-privacy.md) in Azure Machine Learning solutions.
60+
5861
### Frameworks for interpretable and fair models
5962

6063
Machine learning systems are used in different areas of society such as banking, education, and healthcare. As such, it's important for these systems to be accountable for the predictions and recommendations they make to prevent unintended consequences.
@@ -90,7 +93,7 @@ Container technologies such as Docker are one way to deploy models as web servic
9093

9194
Securing deployments is an important part of the deployment process. To [deploy encrypted inferencing services](how-to-homomorphic-encryption-seal.md), use the `encrypted-inference` open-source Python library. The `encrypted inferencing` package provides bindings based on [Microsoft SEAL](https://github.com/Microsoft/SEAL), a homomorphic encryption library.
9295

93-
## Machine Learning Operations (MLOps)
96+
## Machine learning operations (MLOps)
9497

9598
Machine Learning Operations (MLOps), commonly thought of as DevOps for machine learning allows you to build more transparent, resilient, and reproducible machine learning workflows. See the [what is MLOps article](./concept-model-management-and-deployment.md) to learn more about MLOps.
9699

articles/machine-learning/how-to-deploy-and-where.md

Lines changed: 12 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: How to deploy machine learning models
2+
title: Deploy machine learning models
33
titleSuffix: Azure Machine Learning
44
description: 'Learn how and where to deploy machine learning models. Deploy to Azure Container Instances, Azure Kubernetes Service, and FPGA.'
55
services: machine-learning
@@ -8,7 +8,7 @@ ms.subservice: core
88
ms.reviewer: larryfr
99
ms.date: 04/21/2021
1010
ms.topic: how-to
11-
ms.custom: devx-track-python, deploy, devx-track-azurecli, contperf-fy21q2, contperf-fy21q4
11+
ms.custom: devx-track-python, deploy, devx-track-azurecli, contperf-fy21q2, contperf-fy21q4, mktng-kw-nov2021
1212
adobe-target: true
1313
---
1414

@@ -19,15 +19,17 @@ Learn how to deploy your machine learning or deep learning model as a web servic
1919
> [!TIP]
2020
> Managed online endpoints (preview) provide a way to deploy your trained model without your having to create and manage the underlying infrastructure. For more information, see [Deploy and score a machine learning model with a managed online endpoint (preview)](how-to-deploy-managed-online-endpoints.md).
2121
22+
## Workflow for deploying a model
23+
2224
The workflow is similar no matter where you deploy your model:
2325

24-
1. Register the model
25-
1. Prepare an entry script
26-
1. Prepare an inference configuration
27-
1. Deploy the model locally to ensure everything works
28-
1. Choose a compute target
29-
1. Re-deploy the model to the cloud
30-
1. Test the resulting web service
26+
1. Register the model.
27+
1. Prepare an entry script.
28+
1. Prepare an inference configuration.
29+
1. Deploy the model locally to ensure everything works.
30+
1. Choose a compute target.
31+
1. Re-deploy the model to the cloud.
32+
1. Test the resulting web service.
3133

3234
For more information on the concepts involved in the machine learning deployment workflow, see [Manage, deploy, and monitor models with Azure Machine Learning](concept-model-management-and-deployment.md).
3335

@@ -78,7 +80,7 @@ For more information on using the SDK to connect to a workspace, see the [Azure
7880

7981
---
8082

81-
## <a id="registermodel"></a> Register your model
83+
## <a id="registermodel"></a> Register the model
8284

8385
A typical situation for a deployed machine learning service is that you need the following components:
8486

0 commit comments

Comments
 (0)