Skip to content

Commit e3a1a05

Browse files
authored
updates to machine learning data encryption
1 parent 95bf624 commit e3a1a05

File tree

1 file changed

+39
-3
lines changed

1 file changed

+39
-3
lines changed

articles/machine-learning/concept-data-encryption.md

Lines changed: 39 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,12 @@ ms.topic: conceptual
1010
ms.author: jhirono
1111
author: jhirono
1212
ms.reviewer: larryfr
13-
ms.date: 10/20/2022
13+
ms.date: 12/20/2022
1414
---
1515

1616
# Data encryption with Azure Machine Learning
1717

18-
Azure Machine Learning uses a variety of Azure data storage services and compute resources when training models and performing inference. Each of these has their own story on how they provide encryption for data at rest and in transit. In this article, learn about each one and which is best for your scenario.
18+
Azure Machine Learning relies on a variety of Azure data storage services and compute resources when training models and performing inferences. In this article, learn about the data encryption for each service both at rest and in transit.
1919

2020
> [!IMPORTANT]
2121
> For production grade encryption during __training__, Microsoft recommends using Azure Machine Learning compute cluster. For production grade encryption during __inference__, Microsoft recommends using Azure Kubernetes Service.
@@ -24,7 +24,7 @@ Azure Machine Learning uses a variety of Azure data storage services and compute
2424
2525
## Encryption at rest
2626

27-
Azure Machine Learning relies on multiple Azure Services, each of which have their own encryption capabilities.
27+
Azure Machine Learning end to end projects integrate with services like Azure Blob Storage, Azure Cosmos DB, Azure SQL Database etc. The article describes encryption method of such services.
2828

2929
### Azure Blob storage
3030

@@ -38,6 +38,35 @@ If you need to __rotate or revoke__ your key, you can do so at any time. When ro
3838

3939
For information on regenerating the access keys, see [Regenerate storage access keys](how-to-change-storage-access-key.md).
4040

41+
### Azure Data Lake Storage
42+
43+
[!INCLUDE](../../includes/data-lake-storage-gen1-rename-note.md)
44+
45+
**ADLS Gen2**
46+
Azure Data Lake Storage Gen 2 is built on top of Azure Blob Storage and is designed for enterprise big data analytics. ADLS Gen2 is used as a datastore for Azure Machine Learning. Same as Azure Blob Storage the data at rest is encrypted with Microsoft-managed keys.
47+
48+
For information on how to use your own keys for data stored in Azure Data Lake Storage, see [Azure Storage encryption with customer-managed keys in Azure Key Vault](../storage/common/customer-managed-keys-configure-key-vault.md).
49+
50+
### Azure Relational Databases
51+
52+
Azure Machine Learning services supports data from different data sources such as Azure SQL Database, Azure PostgreSQL and Azure MYSQL.
53+
54+
**Azure SQL Database**
55+
Transparent Data Encryption protects Azure SQL Database against threat of malicious offline activity by encrypting data at rest. By default, TDE is enabled for all newly deployed SQL Databases with Microsoft managed keys.
56+
57+
For information on how to use customer managed keys for transparent data encryption, see [Azure SQL Database Transparent Data Encryption](/azure/azure-sql/database/transparent-data-encryption-tde-overview) .
58+
59+
**Azure Database for PostgreSQL**
60+
Azure PostgreSQL leverages Azure Storage encryption to encrypt data at rest by default using Microsoft managed keys. For Azure PostgreSQL users, it is a very similar to Transparent Data Encryption (TDE) in other databases such as SQL Server.
61+
62+
For information on how to use customer managed keys for transparent data encryption, see [Azure Database for PostgreSQL Single server data encryption with a customer-managed key](../postgresql/single-server/concepts-data).
63+
64+
**Azure Database for MySQL**
65+
Azure Database for MySQL is a relational database service in the Microsoft cloud based on the MySQL Community Edition database engine. The Azure Database for MySQL service uses the FIPS 140-2 validated cryptographic module for storage encryption of data at-rest.
66+
67+
To encrypt data using customer managed keys, see [Azure Database for MySQL data encryption with a customer-managed key](../mysql/single-server/concepts-data-encryption-mysql.md) .
68+
69+
4170
### Azure Cosmos DB
4271

4372
Azure Machine Learning stores metadata in an Azure Cosmos DB instance. This instance is associated with a Microsoft subscription managed by Azure Machine Learning. All the data stored in Azure Cosmos DB is encrypted at rest with Microsoft-managed keys.
@@ -105,6 +134,13 @@ The OS disk for compute instance is encrypted with Microsoft-managed keys in Azu
105134

106135
For more information, see [Customer-managed keys](concept-customer-managed-keys.md).
107136

137+
### Azure Data Factory
138+
139+
The Azure Data Factory pipeline is used to ingest data for use with Azure Machine Learning. Azure Data Factory encrypts data at rest, including entity definitions and any data cached while runs are in progress. By default, data is encrypted with a randomly generated Microsoft-managed key that is uniquely assigned to your data factory.
140+
141+
For information on how to use customer managed keys for encryption use [Encrypt Azue Data Factory with customer managed keys](../data-factory/enable-customer-managed-key.md) .
142+
143+
108144
### Azure Databricks
109145

110146
Azure Databricks can be used in Azure Machine Learning pipelines. By default, the Databricks File System (DBFS) used by Azure Databricks is encrypted using a Microsoft-managed key. To configure Azure Databricks to use customer-managed keys, see [Configure customer-managed keys on default (root) DBFS](/azure/databricks/security/customer-managed-keys-dbfs).

0 commit comments

Comments
 (0)