You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-soft-delete.md
+38-37Lines changed: 38 additions & 37 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,15 +1,16 @@
1
1
---
2
2
title: 'Workspace soft deletion'
3
3
titleSuffix: Azure Machine Learning
4
-
description: Soft delete allows you to recover workspace data after accidental deletion
4
+
description: Soft delete allows you to recover workspace data after accidental deletion. Learn how to use the soft delete feature in Azure Machine Learning.
5
5
services: machine-learning
6
6
ms.service: azure-machine-learning
7
7
ms.subservice: core
8
-
ms.topic: conceptual
8
+
ms.topic: concept-article
9
9
ms.author: larryfr
10
10
author: Blackmist
11
11
ms.reviewer: deeikele
12
-
ms.date: 01/22/2024
12
+
ms.date: 09/09/2024
13
+
ms.custom: FY25Q1-Linter
13
14
monikerRange: 'azureml-api-2 || azureml-api-1'
14
15
#Customer intent: As an IT pro, understand how to enable data protection capabilities, to protect against accidental deletion.
15
16
---
@@ -20,45 +21,45 @@ The soft delete feature for Azure Machine Learning workspace provides a data pro
20
21
21
22
## How workspace soft delete works
22
23
23
-
When a workspace is soft deleted, data and metadata stored service-side get soft deleted, but some configurations get hard deleted. Below table provides an overview of which configurations and objects get soft deleted, and which are hard deleted.
24
-
25
-
Data / configuration | Soft deleted | Hard deleted
26
-
---|---|---
27
-
Run History | ✓ |
28
-
Models | ✓ |
29
-
Data | ✓ |
30
-
Environments | ✓ |
31
-
Components | ✓ |
32
-
Notebooks | ✓ |
33
-
Pipelines | ✓ |
34
-
Designer pipelines | ✓ |
35
-
AutoML jobs | ✓ |
36
-
Data labeling projects | ✓ |
37
-
Datastores | ✓ |
38
-
Queued or running jobs | | ✓
39
-
Role assignments | | ✓*
40
-
Internal cache | | ✓
41
-
Compute instance | | ✓
42
-
Compute clusters | | ✓
43
-
Inference endpoints | | ✓
44
-
Linked Databricks workspaces | | ✓*
24
+
When a workspace is soft deleted, data and metadata stored service-side get soft deleted, but some configurations get hard deleted. The following table provides an overview of which configurations and objects get soft deleted, and which are hard deleted.
25
+
26
+
|Data / configuration | Soft deleted | Hard deleted|
27
+
|---|---|---|
28
+
|Run History | ✓ ||
29
+
|Models | ✓ ||
30
+
|Data | ✓ ||
31
+
|Environments | ✓ ||
32
+
|Components | ✓||
33
+
|Notebooks | ✓ ||
34
+
|Pipelines | ✓||
35
+
|Designer pipelines | ✓ ||
36
+
|AutoML jobs | ✓||
37
+
|Data labeling projects | ✓ ||
38
+
|Datastores | ✓ ||
39
+
|Queued or running jobs || ✓|
40
+
|Role assignments || ✓*|
41
+
|Internal cache || ✓ |
42
+
|Compute instance || ✓ |
43
+
|Compute clusters || ✓ |
44
+
|Inference endpoints || ✓ |
45
+
|Linked Databricks workspaces || ✓*|
45
46
46
47
\**Microsoft attempts recreation or reattachment when a workspace is recovered. Recovery isn't guaranteed, and a best effort attempt.*
47
48
48
-
After soft deletion, the service keeps necessary data and metadata during the recovery [retention period](#soft-delete-retention-period). When the retention period expires, or in case you permanently delete a workspace, data and metadata will be actively deleted.
49
+
After soft deletion, the service keeps necessary data and metadata during the recovery [retention period](#soft-delete-retention-period). When the retention period expires, or in case you permanently delete a workspace, data and metadata are actively deleted.
49
50
50
51
## Soft delete retention period
51
52
52
-
A default retention period of 14 days holds for deleted workspaces. The retention period indicates how long workspace data remains available after it's deleted. The clock starts on the retention period as soon as a workspace is soft deleted.
53
+
A default retention period of 14 days holds for deleted workspaces. The retention period indicates how long workspace data remains available after deletion. The clock starts on the retention period as soon as a workspace is soft deleted.
53
54
54
-
During the retention period, soft deleted workspaces can be recovered or permanently deleted. Any other operations on the workspace, like submitting a training job, will fail.
55
+
During the retention period, soft deleted workspaces can be recovered or permanently deleted. Any other operations on the workspace, like submitting a training job, fail.
55
56
56
57
> [!IMPORTANT]
57
58
> You can't reuse the name of a workspace that has been soft deleted until the retention period has passed or the workspace is permanently deleted. Once the retention period elapses, a soft deleted workspace automatically gets permanently deleted.
58
59
59
60
## Deleting a workspace
60
61
61
-
The default deletion behavior when deleting a workspace is soft delete. Optionally, you may override the soft delete behavior by permanently deleting your workspace. Permanently deleting a workspace ensures workspace data is immediately deleted. Use this option to meet related compliance requirements, or whenever you require a workspace name to be reused immediately after deletion. This may be useful in dev/test scenarios where you want to create and later delete a workspace.
62
+
The default deletion behavior when deleting a workspace is soft delete. Optionally, you might override the soft delete behavior by permanently deleting your workspace. Permanently deleting a workspace ensures workspace data is immediately deleted. Use this option to meet related compliance requirements, or whenever you require a workspace name to be reused immediately after deletion. Overriding the default behavior might be useful in dev/test scenarios where you want to create and later delete a workspace.
62
63
63
64
When deleting a workspace from the Azure portal, check __Delete the workspace permanently__. You can permanently delete only one workspace at a time, and not using a batch operation.
64
65
@@ -70,7 +71,7 @@ When deleting a workspace from the Azure portal, check __Delete the workspace pe
70
71
71
72
:::moniker-end
72
73
:::moniker range="azureml-api-2"
73
-
If you are using the [Azure Machine Learning SDK or CLI](/python/api/azure-ai-ml/azure.ai.ml.operations.workspaceoperations#azure-ai-ml-operations-workspaceoperations-begin-delete), you can set the `permanently_delete` flag.
74
+
If you're using the [Azure Machine Learning SDK or CLI](/python/api/azure-ai-ml/azure.ai.ml.operations.workspaceoperations#azure-ai-ml-operations-workspaceoperations-begin-delete), you can set the `permanently_delete` flag.
74
75
75
76
```python
76
77
from azure.ai.ml import MLClient
@@ -109,22 +110,22 @@ Soft deleted workspaces can be managed under the Azure Machine Learning resource
109
110
110
111
## Recover a soft deleted workspace
111
112
112
-
When you select *Recover* on a soft deleted workspace, it initiates an operation to restore the workspace state. The service attempts recreation or reattachment of a subset of resources, including Azure RBAC role assignments. Hard-deleted resources including compute clusters should be recreated by you.
113
+
When you select *Recover* on a soft deleted workspace, it initiates an operation to restore the workspace state. The service attempts recreation or reattachment of a subset of resources, including Azure RBAC role assignments. You must recreate hard-deleted resources, including compute clusters.
113
114
114
-
Azure Machine Learning recovers Azure RBAC role assignments for the workspace identity, but doesn't recover role assignments you have added on the workspace. It may take up to 15 minutes for role assignments to propagate after workspace recovery.
115
+
Azure Machine Learning recovers Azure RBAC role assignments for the workspace identity, but doesn't recover role assignments you added on the workspace. It might take up to 15 minutes for role assignments to propagate after workspace recovery.
115
116
116
-
Recovery of a workspace may not always be possible. Azure Machine Learning stores workspace metadata on [other Azure resources associated with the workspace](concept-workspace.md#associated-resources). In the event these dependent Azure resources were deleted, it may prevent the workspace from being recovered or correctly restored. Dependencies of the Azure Machine Learning workspace must be recovered first, before recovering a deleted workspace. The following table outlines recovery options for each dependency of the Azure Machine Learning workspace.
117
+
Recovery of a workspace isn't always possible. Azure Machine Learning stores workspace metadata on [other Azure resources associated with the workspace](concept-workspace.md#associated-resources). In the event these dependent Azure resources were deleted, it might prevent the workspace from being recovered or correctly restored. Dependencies of the Azure Machine Learning workspace must be recovered first, before recovering a deleted workspace. The following table outlines recovery options for each dependency of the Azure Machine Learning workspace.
117
118
118
119
|Dependency|Recovery approach|
119
120
|---|---|
120
121
|Azure Key Vault|[Recover a deleted Azure Key Vault instance](/azure/key-vault/general/soft-delete-overview)|
121
122
|Azure Storage|[Recover a deleted Azure storage account](/azure/storage/common/storage-account-recover).|
122
-
|Azure Container Registry|Azure Container Registry is not a hard requirement for workspace recovery. Azure Machine Learning can regenerate images for custom environments.|
123
+
|Azure Container Registry|Azure Container Registry isn't a hard requirement for workspace recovery. Azure Machine Learning can regenerate images for custom environments.|
123
124
|Azure Application Insights| First, [recover your log analytics workspace](/azure/azure-monitor/logs/delete-workspace). Then recreate an application insights with the original name.|
124
125
125
126
## Billing implications
126
127
127
-
In general, when a workspace is in soft deleted state, there are only two operations possible: 'permanently delete' and 'recover'. All other operations will fail. Therefore, even though the workspace exists, no compute operations can be performed and hence no usage will occur. When a workspace is soft deleted, any cost-incurring resources including compute clusters are hard deleted.
128
+
In general, when a workspace is in soft deleted state, there are only two operations possible: 'permanently delete' and 'recover'. All other operations fail. Therefore, even though the workspace exists, no compute operations can be performed, and hence no usage occurs. When a workspace is soft deleted, any cost-incurring resources including compute clusters are hard deleted.
128
129
129
130
> [!IMPORTANT]
130
131
> Workspaces that use [customer-managed keys for encryption](concept-data-encryption.md) store additional service data in your subscription in a managed resource group. When a workspace is soft deleted, the managed resource group and resources in it will not be deleted and will incur cost until the workspace is hard-deleted.
@@ -133,11 +134,11 @@ In general, when a workspace is in soft deleted state, there are only two operat
133
134
134
135
After soft deletion, the service keeps necessary data and metadata during the recovery [retention period](#soft-delete-retention-period). From a GDPR and privacy perspective, a request to delete personal data should be interpreted as a request for *permanent* deletion of a workspace and not soft delete.
135
136
136
-
When the retention period expires, or in case you permanently delete a workspace, data and metadata will be actively deleted. You could choose to permanently delete a workspace at the time of deletion.
137
+
When the retention period expires, or in case you permanently delete a workspace, data and metadata are actively deleted. You could choose to permanently delete a workspace at the time of deletion.
137
138
138
139
For more information, see the [Export or delete workspace data](how-to-export-delete-data.md) article.
139
140
140
-
## Next steps
141
+
## Related content
141
142
142
143
+[Create and manage a workspace](how-to-manage-workspace.md)
143
144
+[Export or delete workspace data](how-to-export-delete-data.md)
0 commit comments