You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: About Azure Data Lake Storage Gen 2 Vaulted Backup (preview)
2
+
title: About Azure Data Lake Storage Gen2 Vaulted Backup (preview)
3
3
description: Learn how the Azure Data Lake Storage Gen2 vaulted backup works
4
4
ms.topic: overview
5
5
ms.date: 04/16/2025
@@ -8,57 +8,61 @@ ms.author: jsuri
8
8
ms.custom: engagement-fy24
9
9
---
10
10
11
-
# About Azure Data Lake Storage Gen 2 vaulted backup (preview)
11
+
# About Azure Data Lake Storage Gen2 vaulted backup (preview)
12
12
13
-
[Azure Data Lake Storage (ADLS)](/azure/storage/blobs/data-lake-storage-introduction) vaulted backup (preview) is a streamlined, cloud-native solution for backing up and restoring general-purpose v2 storage accounts with a [hierarchical namespace](/azure/storage/blobs/data-lake-storage-namespace). It allows selective backup and restoration of containers, storing backups in a dedicated vault for granular control.
13
+
[Azure Data Lake Storage (ADLS)](/azure/storage/blobs/data-lake-storage-introduction) vaulted backup (preview) is a streamlined, cloud-native solution to back up and restore general-purpose v2 storage accounts with a [hierarchical namespace](/azure/storage/blobs/data-lake-storage-namespace). It allows selective backup and restoration of containers, and store backups in a dedicated vault for granular control.
14
14
15
15
>[!Note]
16
16
>- This feature is currently in limited preview and is available in specific regions only. See the [supported regions](azure-data-lake-storage-backup-support-matrix.md#supported-regions).
17
17
>- To enroll in this preview feature, fill [this form](https://forms.office.com/r/sixidTkYb4) and write to [[email protected]](mailto:[email protected]).
18
18
19
-
## Azure Data Lake Storage Gen 2 backup workflow
19
+
## Azure Data Lake Storage Gen2 backup workflow
20
20
21
21
Vaulted backup uses platform capabilities such as snapshots and object replication to copy data to the Backup vault. Object replication asynchronously copies block blobs from a source storage account to a destination backup storage account, including the blob's contents, versions, metadata, and properties.
22
22
23
-
When protection is configured, Azure Backup sets up a destination storage account within the Backup vault and applies an object replication policy at the container level for both source and destination accounts. During backup, Azure Backup places a recovery point marker on the source account and tracks its replication. After the marker is replicated to the destination, the recovery point is created.
23
+
When you configure protection, Azure Backup sets up a destination storage account within the Backup vault and applies an object replication policy at the container level for both source and destination accounts. During backup, Azure Backup places a recovery point marker on the source account and tracks its replication. After the marker is replicated to the destination, the recovery point is created.
24
24
25
25
*The following diagram shows the recovery point creation process after the snapshot is taken:*
26
26
27
27
:::image type="content" source="./media/azure-data-lake-storage-backup-overview/recovery-point-creation-architecture.png" alt-text="Diagram shows the recovery point creation process in the backup flow.":::
28
28
29
-
Learn about the [supported scenarios and limitations for Azure Data Lake Storage Gen 2 backup](azure-data-lake-storage-backup-support-matrix.md).
29
+
Learn about the [supported scenarios and limitations for Azure Data Lake Storage Gen2 backup](azure-data-lake-storage-backup-support-matrix.md).
30
30
31
31
## ADLS backup configuration and retention
32
32
33
-
The ADLS backup requires a Backup vault that provides a centralized view of configured backups. Vaulted backup is set at the storage account level, with the option to exclude containers. If an account has over 100 containers, reduce the count to 100 or less.
33
+
The ADLS backup requires a Backup vault that provides a centralized view of configured backups. Vaulted backup is set at the storage account level, with the option to exclude containers.
34
+
>[!Note]
35
+
>If an account has over 100 containers, reduce the count to **<= 100**. Learn [about the supported container count for backup](azure-data-lake-storage-backup-support-matrix.md#protection-limits).
34
36
35
-
Backup policies manage schedules and retention, supporting daily or weekly backups and recovery point creation. Retention can be set for daily, weekly, monthly, or yearly backups and can be retained up to **10 years**, with yearly rules taking priority. Default retention applies if no other rules are set.
37
+
Backup policies manage schedules and retention, supporting daily or weekly backups and recovery point creation. Retention can be set for daily, weekly, monthly, or yearly backups and can be retained up to **10 years**, with yearly rules taking priority. If no other rules are set, the default retention rule applies.
36
38
37
39
Azure Backup automatically runs scheduled jobs, replicating block blobs from the source to the destination storage account. It preserves contents, versions, metadata, and properties based on the backup frequency. Backups remain in the vault per policy and are deleted once the retention period ends.
38
40
39
-
Backup can be enabled for multiple storage accounts in a single vault using one or multiple backup policies. Vaulted backups support long-term retention for up to 10 years.
41
+
>[!Note]
42
+
>- Backup can be enabled for multiple storage accounts in a single vault using one or multiple backup policies.
43
+
>- Vaulted backups support long-term retention for up to 10 years.
40
44
41
45
### Backup management
42
46
43
47
After the ADLS backup configuration is complete, a backup instance is created in the Backup vault. Use it to initiate restores, monitor activity, stop protection, and perform other backup operations.
44
48
45
-
The Backup vault's managed identity needs specific permissions on storage accounts for backup and restore operations. These permissions are bundled into the **Storage Account Backup Contributor** role for easy management.
49
+
The Backup vault's managed identity needs specific permissions on storage accounts for backup and restore operations. These permissions are bundled into the **Storage Account Backup Contributor** role for ease of management.
46
50
47
-
Assign the role to the Backup vault before configuring backup for easier setup. Alternatively, you can assign it during configuration. A managed identity is a service principal exclusive to Azure resources.
51
+
You can assign the role to the Backup vault before/during configuring backup. A managed identity is a service principal exclusive to Azure resources.
48
52
Learn more about [managed identities](/azure/active-directory/managed-identities-azure-resources/overview).
49
53
50
54
### Restoration from backups
51
55
52
-
You can restore data from any point in time where a recovery point exists. Recovery points are created when a storage account is in a protected state and remain available for restoration as long as they fall within the retention period defined by the backup policy. You can choose to perform a granular recovery by selecting specific containers, applying a prefix-based filter, or restore the entire storage account.
56
+
You can restore data from any point in time where a recovery point exists. Recovery points are created when a storage account is in a protected state, and remain available for restoration as long as they fall within the retention period defined by the backup policy. You can choose to perform a granular recovery by selecting specific containers, applying a prefix-based filter, or restore the entire storage account.
53
57
54
58
55
59
Azure Backup allows restoring data from any recovery point within the retention period set by the backup policy. Recovery points are created when the storage account is in protected state, and can be used to restore until they expire as per the retention policy. This solution allows performing granular recovery by selecting containers, applying a prefix-based filter, or restoring the full storage account.
56
60
57
61
>[!Note]
58
-
>- To restore a recovery point to a different subscription, request the Azure Backup team to allowlist the required subscription and grant access by using the same [signup form](https://forms.office.com/r/sixidTkYb4).
62
+
>- To restore a recovery point to a different subscription, request the Azure Backup team to allowlist the required subscription and grant access by using the [signup form](https://forms.office.com/r/sixidTkYb4).
59
63
>- Currently, the vaulted backup solution supports restoring data only to a different storage account within the same region as the vault. However, restoring data from older recovery points might result in a longer recovery time (higher [Recovery Time Objective](azure-backup-glossary.md#recovery-time-objective-rto)).
60
64
61
65
## Next steps
62
66
63
-
- [Configure vaulted backup for Azure Data Lake Storage Gen 2 using Azure portal (preview)](azure-data-lake-storage-configure-backup.md).
64
-
- [Restore Azure Data Lake Storage Gen 2 using Azure portal (preview)](azure-data-lake-storage-restore.md).
67
+
- [Configure vaulted backup for Azure Data Lake Storage Gen2 using Azure portal (preview)](azure-data-lake-storage-configure-backup.md).
68
+
- [Restore Azure Data Lake Storage Gen2 using Azure portal (preview)](azure-data-lake-storage-restore.md).
Copy file name to clipboardExpand all lines: articles/backup/azure-data-lake-storage-backup-support-matrix.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -36,14 +36,14 @@ The following table lists the protection setting limit:
36
36
| Maximum number of containers in a storage account that can be protected | 100 |
37
37
| Vault redundancy | LRS/ZRS|
38
38
39
-
### Supported protection scenarios
39
+
### Support scenarios for protection
40
40
41
-
The following protection scenarios are currently supported:
41
+
Azure Data Lake Storage Gen2 protection (preview) has the following supported and unsupported scenarios:
42
42
43
-
-To back up any new containers that get created after backup configuration for the storage account, modify the protection of the storage account. These containers aren't backed up automatically.
43
+
-Any new containers that get created after backup configuration for the storage account aren't backed up automatically. To enable the backup operation for the new containers, modify the protection of the storage account.
44
44
- The storage accounts to be backed up must contain a *minimum of one container*. If the storage account doesn't contain any containers or if no containers are selected, an error may appear when you configure backup.
45
45
- The backup operation isn't supported for blobs that are uploaded by using [Data Lake Storage APIs](/rest/api/storageservices/data-lake-storage-gen2).
46
-
-Similarly, if you delete and recreate a container with the same name, **Object Replication** doesn't track the change, and future Recovery Points still include the previous blobs and versions.
46
+
-If you delete and recreate a container with the same name, **Object Replication** doesn't track the change, and future Recovery Points still include the previous blobs and versions.
47
47
- Backup vaults with User-Assigned Managed Identity (UAMI) aren't compatible with Azure Blob Vaulted backups. Only System-Assigned Managed Identity (SAMI) works, because the vault needs to access the storage account where the blobs are stored. The vault uses its system-assigned managed identity for this access.
48
48
- Enabling backups isn't supported for the blob container that are configured with native replication using data factory.
49
49
- You can protect the storage account with the vault in another subscription but in the same region as storage account.
@@ -89,5 +89,5 @@ The following table lists the Retention setting limits:
89
89
90
90
## Next steps
91
91
92
-
-[Configure vaulted backup for Azure Data Lake Storage Gen 2 using Azure portal (preview)](azure-data-lake-storage-configure-backup.md).
93
-
-[Restore Azure Data Lake Storage Gen 2 using Azure portal (preview)](azure-data-lake-storage-restore.md).
92
+
-[Configure vaulted backup for Azure Data Lake Storage Gen2 using Azure portal (preview)](azure-data-lake-storage-configure-backup.md).
93
+
-[Restore Azure Data Lake Storage Gen2 using Azure portal (preview)](azure-data-lake-storage-restore.md).
Copy file name to clipboardExpand all lines: articles/backup/azure-data-lake-storage-configure-backup.md
+15-12Lines changed: 15 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,29 +1,31 @@
1
1
---
2
-
title: Configure Vaulted Backup for Azure Data Lake Storage Gen 2 using Azure Portal (preview)
3
-
description: Learn how to configure vaulted backup for Azure Data Lake Storage Gen 2 using Azure portal.
2
+
title: Configure Vaulted Backup for Azure Data Lake Storage Gen2 using Azure Portal (preview)
3
+
description: Learn how to configure vaulted backup for Azure Data Lake Storage Gen2 (preview) using Azure portal.
4
4
ms.topic: how-to
5
5
ms.date: 04/16/2025
6
6
author: jyothisuri
7
7
ms.author: jsuri
8
8
---
9
9
10
-
# Configure vaulted backup for Azure Data Lake Storage Gen 2 using Azure portal (preview)
10
+
# Configure vaulted backup for Azure Data Lake Storage Gen2 using Azure portal (preview)
11
11
12
-
This article describes how to configure [vaulted backup for Azure Data Lake Storage Gen 2](azure-data-lake-storage-backup-overview.md) using Azure portal (preview).
12
+
This article describes how to configure vaulted backup for Azure Data Lake Storage Gen2 (preview) using Azure portal.
13
13
14
14
## Prerequisites
15
15
16
16
Before you configure backup for Azure Data Lake Storage, ensure the following prerequisites are met:
17
17
18
-
- The storage account must be in a supported region and of the required types. See the [support matrix](azure-data-lake-storage-backup-support-matrix.md).
19
-
- Vaulted backup restores are only possible to a different storage account.
18
+
- The storage account must be in a [supported region and of the required types](azure-data-lake-storage-backup-support-matrix.md).
20
19
- The target account mustn't have containers with the names same as the containers in a recovery point; otherwise, the restore operation fails.
21
20
21
+
>[!Note]
22
+
>Vaulted backup restores are only possible to a different storage account.
23
+
22
24
For more information about the supported scenarios, limitations, and availability, see the [support matrix](azure-data-lake-storage-backup-support-matrix.md).
23
25
24
26
## Create a Backup vault
25
27
26
-
To back up Azure Data Lake Storage Gen2, ensure you have a Backup Vault in the same region. You can use an existing vault, or create a new one. Learn how to [create a Backup vault](create-manage-backup-vault.md#create-backup-vault).
28
+
To back up Azure Data Lake Storage Gen2, ensure you have a Backup Vault in the same region. You can use an existing vault, or [create a new one](create-manage-backup-vault.md#create-backup-vault).
27
29
28
30
## Create a backup policy
29
31
@@ -32,7 +34,7 @@ A backup policy defines the schedule and frequency for backing up Azure Data Lak
32
34
To create a backup policy for Azure Data Lake Storage from the Backup vault, follow these steps:
33
35
34
36
1. In the [Azure portal](https://portal.azure.com/), go to the **Backup vault** > **Backup policies**, and then select **+ Add**.
35
-
1. On the **Create Backup Policy** pane, on the **Basics** tab, provide a name for the new policy on **Policy name**, and then select **Datasource type** as **Azure Data Lake Storage Gen2s (Preview)**.
37
+
1. On the **Create Backup Policy** pane, on the **Basics** tab, provide a name for the new policy on **Policy name**, and then select **Datasource type** as **Azure Data Lake Storage Gen2 (Preview)**.
36
38
37
39
:::image type="content" source="./media/azure-data-lake-storage-configure-backup/create-policy.png" alt-text="Screenshot shows how to start creating a backup policy." lightbox="./media/azure-data-lake-storage-configure-backup/create-policy.png":::
38
40
@@ -76,14 +78,15 @@ You can configure backup on multiple Azure Data Lake Storage Gen2s.
76
78
To configure backup, follow these steps:
77
79
78
80
1. In the [Azure portal](https://portal.azure.com/), go to the **Backup vault**, and then select **+ Backup**.
79
-
1. On the **Configure Backup** pane, on the **Backup policy** tab, under **Backup policy**, select the policy you want to use for data retention, and then select **Next**.
80
-
If you want to create a new backup policy, select **Create new**.
81
+
1. On the **Configure Backup** pane, on the **Basics** tab, review the **Datasouce type** is selected as **Azure Data Lake Storage Gen2 (preview)**.
82
+
1. On the **Backup policy** tab, under **Backup policy**, select the policy you want to use for data retention, and then select **Next**.
83
+
If you want to create a new backup policy, select **Create new**. learn how to [create a backup policy](#create-a-backup-policy).
81
84
82
85
1. On the **Datasources** tab, Select**Add**.
83
86
84
87
:::image type="content" source="./media/azure-data-lake-storage-configure-backup/add-resource-for-backup.png" alt-text="Screenshot shows how to add resources for backup." lightbox="./media/azure-data-lake-storage-configure-backup/add-resource-for-backup.png":::
85
88
86
-
1. On the **Select storage account container** pane, provide the **Backup Instance name**, and then click **Select** under **Storage account**.
89
+
1. On the **Select storage account container** pane, provide the **Backup instance name**, and then click **select** under **Storage account**.
87
90
88
91
:::image type="content" source="./media/azure-data-lake-storage-configure-backup/specify-backup-instance-name.png" alt-text="Screenshot shows how to provide the backup instance name." lightbox="./media/azure-data-lake-storage-configure-backup/specify-backup-instance-name.png":::
89
92
@@ -112,7 +115,7 @@ You can track the progress of the backup configuration under **Backup instances*
112
115
113
116
## Next steps
114
117
115
-
[Restore Azure Data Lake Storage using Azure portal (preview)](azure-data-lake-storage-restore.md).
118
+
[Restore Azure Data Lake Storage Gen2 using Azure portal (preview)](azure-data-lake-storage-restore.md).
0 commit comments