You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-customer-managed-keys.md
+17-7Lines changed: 17 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,8 +9,9 @@ ms.topic: conceptual
9
9
ms.author: jhirono
10
10
author: jhirono
11
11
ms.reviewer: larryfr
12
-
ms.date: 01/19/2023
12
+
ms.date: 09/12/2023
13
13
ms.custom: engagement-fy23
14
+
monikerRange: 'azureml-api-2 || azureml-api-1'
14
15
---
15
16
# Customer-managed keys for Azure Machine Learning
16
17
@@ -20,7 +21,7 @@ Azure Machine Learning is built on top of multiple Azure services. While the dat
20
21
21
22
In addition to customer-managed keys, Azure Machine Learning also provides a [hbi_workspace flag](/python/api/azure-ai-ml/azure.ai.ml.entities.workspace). Enabling this flag reduces the amount of data Microsoft collects for diagnostic purposes and enables [extra encryption in Microsoft-managed environments](../security/fundamentals/encryption-atrest.md). This flag also enables the following behaviors:
22
23
23
-
* Starts encrypting the local scratch disk in your Azure Machine Learning compute cluster, provided you haven’t created any previous clusters in that subscription. Else, you need to raise a support ticket to enable encryption of the scratch disk of your compute clusters.
24
+
* Starts encrypting the local scratch disk in your Azure Machine Learning compute cluster, provided you haven't created any previous clusters in that subscription. Else, you need to raise a support ticket to enable encryption of the scratch disk of your compute clusters.
24
25
* Cleans up your local scratch disk between jobs.
25
26
* Securely passes credentials for your storage account, container registry, and SSH account from the execution layer to your compute clusters using your key vault.
26
27
@@ -43,15 +44,15 @@ In addition to customer-managed keys, Azure Machine Learning also provides a [hb
43
44
44
45
## Limitations
45
46
46
-
* The customer-managed key for resources the workspace depends on can’t be updated after workspace creation.
47
-
* Resources managed by Microsoft in your subscription can’t transfer ownership to you.
47
+
* The customer-managed key for resources the workspace depends on can't be updated after workspace creation.
48
+
* Resources managed by Microsoft in your subscription can't transfer ownership to you.
48
49
* You can't delete Microsoft-managed resources used for customer-managed keys without also deleting your workspace.
49
50
50
51
## How workspace metadata is stored
51
52
52
53
The following resources store metadata for your workspace:
53
54
54
-
| Service | How it’s used |
55
+
| Service | How it's used |
55
56
| ----- | ----- |
56
57
| Azure Cosmos DB | Stores job history data. |
57
58
| Azure Cognitive Search | Stores indices that are used to help query your machine learning content. |
@@ -84,12 +85,21 @@ These Microsoft-managed resources are located in a new Azure resource group is c
84
85
85
86
Azure Machine Learning uses compute resources to train and deploy machine learning models. The following table describes the compute options and how data is encrypted by each one:
86
87
88
+
:::moniker range="azureml-api-1"
87
89
| Compute | Encryption |
88
90
| ----- | ----- |
89
91
| Azure Container Instance | Data is encrypted by a Microsoft-managed key or a customer-managed key.</br>For more information, see [Encrypt data with a customer-managed key](../container-instances/container-instances-encrypt-data.md). |
90
92
| Azure Kubernetes Service | Data is encrypted by a Microsoft-managed key or a customer-managed key.</br>For more information, see [Bring your own keys with Azure disks in Azure Kubernetes Services](../aks/azure-disk-customer-managed-keys.md). |
91
93
| Azure Machine Learning compute instance | Local scratch disk is encrypted if the `hbi_workspace` flag is enabled for the workspace. |
92
94
| Azure Machine Learning compute cluster | OS disk encrypted in Azure Storage with Microsoft-managed keys. Temporary disk is encrypted if the `hbi_workspace` flag is enabled for the workspace. |
95
+
:::moniker-end
96
+
:::moniker range="azureml-api-2"
97
+
| Compute | Encryption |
98
+
| ----- | ----- |
99
+
| Azure Kubernetes Service | Data is encrypted by a Microsoft-managed key or a customer-managed key.</br>For more information, see [Bring your own keys with Azure disks in Azure Kubernetes Services](../aks/azure-disk-customer-managed-keys.md). |
100
+
| Azure Machine Learning compute instance | Local scratch disk is encrypted if the `hbi_workspace` flag is enabled for the workspace. |
101
+
| Azure Machine Learning compute cluster | OS disk encrypted in Azure Storage with Microsoft-managed keys. Temporary disk is encrypted if the `hbi_workspace` flag is enabled for the workspace. |
102
+
:::moniker-end
93
103
94
104
**Compute cluster**
95
105
The OS disk for each compute node stored in Azure Storage is encrypted with Microsoft-managed keys in Azure Machine Learning storage accounts. This compute target is ephemeral, and clusters are typically scaled down when no jobs are queued. The underlying virtual machine is de-provisioned, and the OS disk is deleted. Azure Disk Encryption isn't supported for the OS disk.
@@ -101,8 +111,8 @@ The OS disk for compute instance is encrypted with Microsoft-managed keys in Azu
101
111
102
112
### HBI_workspace flag
103
113
104
-
* The `hbi_workspace` flag can only be set when a workspace is created. It can’t be changed for an existing workspace.
105
-
* When this flag is set to True, it may increase the difficulty of troubleshooting issues because less telemetry data is sent to Microsoft. There’s less visibility into success rates or problem types. Microsoft may not be able to react as proactively when this flag is True.
114
+
* The `hbi_workspace` flag can only be set when a workspace is created. It can't be changed for an existing workspace.
115
+
* When this flag is set to True, it may increase the difficulty of troubleshooting issues because less telemetry data is sent to Microsoft. There's less visibility into success rates or problem types. Microsoft may not be able to react as proactively when this flag is True.
106
116
107
117
To enable the `hbi_workspace` flag when creating an Azure Machine Learning workspace, follow the steps in one of the following articles:
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-setup-customer-managed-keys.md
+8-7Lines changed: 8 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,8 @@ ms.topic: conceptual
10
10
ms.author: jhirono
11
11
author: jhirono
12
12
ms.reviewer: larryfr
13
-
ms.date: 01/20/2023
13
+
ms.date: 09/12/2023
14
+
monikerRange: 'azureml-api-2 || azureml-api-1'
14
15
---
15
16
# Use customer-managed keys with Azure Machine Learning
16
17
@@ -27,7 +28,7 @@ In the [customer-managed keys concepts article](concept-customer-managed-keys.md
27
28
| Resource provider | Why it's needed |
28
29
| ----- | ----- |
29
30
| Microsoft.MachineLearningServices | Creating the Azure Machine Learning workspace.
30
-
| Microsoft.StorageAzure | Storage Account is used as the default storage for the workspace.
31
+
| Microsoft.StorageAzure | Storage Account is used as the default storage for the workspace.
31
32
| Microsoft.KeyVault |Azure Key Vault is used by the workspace to store secrets.
32
33
| Microsoft.DocumentDB/databaseAccounts | Azure Cosmos DB instance that logs metadata for the workspace.
33
34
| Microsoft.Search/searchServices | Azure Search provides indexing capabilities for the workspace.
@@ -37,8 +38,8 @@ In the [customer-managed keys concepts article](concept-customer-managed-keys.md
37
38
38
39
## Limitations
39
40
40
-
* The customer-managed key for resources the workspace depends on can’t be updated after workspace creation.
41
-
* Resources managed by Microsoft in your subscription can’t transfer ownership to you.
41
+
* The customer-managed key for resources the workspace depends on can't be updated after workspace creation.
42
+
* Resources managed by Microsoft in your subscription can't transfer ownership to you.
42
43
* You can't delete Microsoft-managed resources used for customer-managed keys without also deleting your workspace.
43
44
* The key vault that contains your customer-managed key must be in the same Azure subscription as the Azure Machine Learning workspace.
44
45
* OS disk of machine learning compute can't be encrypted with customer-managed key, but can be encrypted with Microsoft-managed key if the workspace is created with `hbi_workspace` parameter set to `TRUE`. For more details, see [Data encryption](concept-data-encryption.md#machine-learning-compute).
@@ -131,6 +132,7 @@ Once the workspace has been created, you'll notice that Azure resource group is
131
132
132
133
For more information on customer-managed keys with Azure Cosmos DB, see [Configure customer-managed keys for your Azure Cosmos DB account](../cosmos-db/how-to-setup-cmk.md).
133
134
135
+
:::moniker range="azureml-api-1"
134
136
### Azure Container Instance
135
137
136
138
> [!IMPORTANT]
@@ -146,12 +148,11 @@ To use the key when deploying a model to Azure Container Instance, create a new
146
148
147
149
For more information on creating and using a deployment configuration, see the following articles:
* [Deploy a model to Azure Container Instances (SDK/CLI v1)](v1/how-to-deploy-azure-container-instance.md)
152
153
153
154
For more information on using a customer-managed key with ACI, see [Encrypt deployment data](../container-instances/container-instances-encrypt-data.md).
154
-
155
+
:::moniker-end
155
156
### Azure Kubernetes Service
156
157
157
158
You may encrypt a deployed Azure Kubernetes Service resource using customer-managed keys at any time. For more information, see [Bring your own keys with Azure Kubernetes Service](../aks/azure-disk-customer-managed-keys.md).
| Azure Kubernetes Service | Hosting trained models as inference endpoints |
19
+
20
+
> [!TIP]
21
+
> * Azure Cosmos DB, Cognitive Search, and Storage Account are secured using the same key. You can use a different key for Azure Kubernetes Service.
22
+
> * To use a customer-managed key with Azure Cosmos DB, Cognitive Search, and Storage Account, the key is provided when you create your workspace. The key used with Kubernetes Service is provided when configuring that resource.
23
+
:::moniker-end
24
+
:::moniker range="azureml-api-1"
25
+
| Service | What it's used for |
26
+
| ----- | ----- |
27
+
| Azure Cosmos DB | Stores metadata for Azure Machine Learning |
> * Azure Cosmos DB, Cognitive Search, and Storage Account are secured using the same key. You can use a different key for Azure Kubernetes Service and Container Instance.
21
-
> * To use a customer-managed key with Azure Cosmos DB, Cognitive Search, and Storage Account, the key is provided when you create your workspace. The key(s) used with Azure Container Instance and Kubernetes Service are provided when configuring those resources.
35
+
> * To use a customer-managed key with Azure Cosmos DB, Cognitive Search, and Storage Account, the key is provided when you create your workspace. The key(s) used with Azure Container Instance and Kubernetes Service are provided when configuring those resources.
0 commit comments