Skip to content

Commit f4aadd1

Browse files
Merge pull request #230635 from normesta/gen2
Embedding a video
2 parents 7024a87 + fdbfb96 commit f4aadd1

File tree

1 file changed

+15
-26
lines changed

1 file changed

+15
-26
lines changed

articles/storage/blobs/data-lake-storage-migrate-gen1-to-gen2-azure-portal.md

Lines changed: 15 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -6,40 +6,29 @@ author: normesta
66

77
ms.topic: how-to
88
ms.author: normesta
9-
ms.date: 03/09/2023
9+
ms.date: 03/14/2023
1010
ms.service: storage
11-
ms.reviewer: rukmani-msft
1211
ms.subservice: data-lake-storage-gen2
1312
---
1413

1514
# Migrate Azure Data Lake Storage from Gen1 to Gen2 by using the Azure portal
1615

1716
On **Feb. 29, 2024** Azure Data Lake Storage Gen1 will be retired. For more information, see the [official announcement](https://azure.microsoft.com/updates/action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024/). If you use Azure Data Lake Storage Gen1, make sure to migrate to Azure Data Lake Storage Gen2 prior to that date.
1817

19-
This article shows you how to simplify the migration by using the Azure portal. You can provide your consent in the Azure portal and then migrate your data and metadata (such as timestamps and ACLs) automatically from Azure Data Lake Storage Gen1 to Azure Data Lake Storage Gen2. For easier reading, this article uses the term *Gen1* to refer to Azure Data Lake Storage Gen1, and the term *Gen2* to refer to Azure Data Lake Storage Gen2.
18+
This article shows you how to simplify the migration by using the Azure portal. You can provide your consent in the Azure portal and then migrate your data and metadata (such as timestamps and ACLs) automatically from Azure Data Lake Storage Gen1 to Azure Data Lake Storage Gen2.
2019

21-
> [!NOTE]
22-
> Your account may not qualify for portal-based migration based on certain constraints. When the **Migrate data** button is not enabled in the Azure portal for your Gen1 account, if you have a support plan, you can [file a support request](https://portal.azure.com/#blade/Microsoft_Azure_Support/HelpAndSupportBlade/newsupportrequest). You can also get answers from community experts in [Microsoft Q&A](/answers/topics/azure-data-lake-storage.html).
23-
24-
> [!WARNING]
25-
> Azure Data Lake Storage Gen2 doesn't support Azure Data Lake Analytics. If you're using Azure Data Lake Analytics, you'll need to migrate before proceeding. See [Migrate Azure Data Lake Analytics workloads](#migrate-azure-data-lake-analytics-workloads) for more information.
26-
27-
To migrate to Gen2 using the Azure portal, follow these steps:
28-
29-
Step 1: Assess readiness
20+
Here's a video that tells you more about it.
3021

31-
- [Verify Azure role-based access control (Azure RBAC) role assignments](#verify-azure-role-based-access-control-azure-rbac-role-assignments)
32-
- [Migrate Azure Data Lake Analytics workloads](#migrate-azure-data-lake-analytics-workloads) (if any)
22+
> [!VIDEO https://learn-video.azurefd.net/vod/player?show=inside-azure-for-it&ep=migrate-azure-data-lake-storage-adls-from-gen1-to-gen2-by-using-the-azure-portal]
3323
34-
Step 2: [Create a storage account with Gen2 capabilities](#create-a-storage-account-with-gen2-capabilities)
35-
36-
Step 3: [Migrate data using the Azure portal](#perform-the-migration)
24+
Before you start, be sure to read the general guidance on how to migrate from Gen1 to Gen2 in [Azure Data Lake Storage migration guidelines and patterns](data-lake-storage-migrate-gen1-to-gen2.md).
3725

38-
Step 4: [Migrate workloads and applications](#migrate-workloads-and-applications)
26+
Your account might not qualify for portal-based migration based on certain constraints. When the **Migrate data** button is not enabled in the Azure portal for your Gen1 account, if you have a support plan, you can [file a support request](https://portal.azure.com/#blade/Microsoft_Azure_Support/HelpAndSupportBlade/newsupportrequest). You can also get answers from community experts in [Microsoft Q&A](/answers/topics/azure-data-lake-storage.html).
3927

40-
Before you start, be sure to read the general guidance on how to migrate from Gen1 to Gen2 in [Azure Data Lake Storage migration guidelines and patterns](data-lake-storage-migrate-gen1-to-gen2.md).
28+
> [!NOTE]
29+
> For easier reading, this article uses the term *Gen1* to refer to Azure Data Lake Storage Gen1, and the term *Gen2* to refer to Azure Data Lake Storage Gen2.
4130
42-
## Create a storage account with Gen2 capabilities
31+
## Step 1: Create a storage account with Gen2 capabilities
4332

4433
Azure Data Lake Storage Gen2 isn't a dedicated storage account or service type. It's a set of capabilities that you can obtain by enabling the **Hierarchical namespace** feature of an Azure storage account. To create an account that has Gen2 capabilities, see [Create a storage account to use with Azure Data Lake Storage Gen2](create-data-lake-storage-account.md).
4534

@@ -60,30 +49,30 @@ As you create the account, make sure to configure settings with the following va
6049
> [!IMPORTANT]
6150
> Ensure that you use a fresh, newly created storage account that has no history of use. **Don't** migrate to a previously used account or use an account in which containers have been deleted to make the account empty.
6251
63-
## Verify Azure role-based access control (Azure RBAC) role assignments
52+
## Step 2: Verify Azure role-based access control (Azure RBAC) role assignments
6453

6554
For Gen2, ensure that the [Storage Blob Data Owner](../../role-based-access-control/built-in-roles.md#storage-blob-data-owner) role has been assigned to your Azure Active Directory (Azure AD) user identity in the scope of the storage account, parent resource group, or subscription.
6655

6756
For Gen1, ensure that the [Owner](../../role-based-access-control/built-in-roles.md#owner) role has been assigned to your Azure AD identity in the scope of the Gen1 account, parent resource group, or subscription.
6857

69-
## Migrate Azure Data Lake Analytics workloads
58+
## Step 3: Migrate Azure Data Lake Analytics workloads
7059

7160
Azure Data Lake Storage Gen2 doesn't support Azure Data Lake Analytics. Azure Data Lake Analytics [will be retired](https://azure.microsoft.com/updates/migrate-to-azure-synapse-analytics/) on February 29, 2024. If you attempt to use the Azure portal to migrate an Azure Data Lake Storage Gen1 account that is used for Azure Data Lake Analytics, it's possible that you'll break your Azure Data Lake Analytics workloads. You must first [migrate your Azure Data Lake Analytics workloads to Azure Synapse Analytics](../../data-lake-analytics/migrate-azure-data-lake-analytics-to-synapse.md) or another supported compute platform before attempting to migrate your Gen1 account.
7261

7362
For more information, see [Manage Azure Data Lake Analytics using the Azure portal](../../data-lake-analytics/data-lake-analytics-manage-use-portal.md).
7463

75-
## Prepare the Gen1 account
64+
## Step 4: Prepare the Gen1 account
7665

7766
File or directory names with only spaces or tabs, ending with a `.`, containing a `:`, or with multiple consecutive forward slashes (`//`) aren't compatible with Gen2. You need to rename these files or directories before you migrate.
7867

79-
## Perform the migration
68+
## Step 5: Perform the migration
8069

8170
Before you begin, review the two migration options below, and decide whether to only copy data from Gen1 to Gen2 (recommended) or perform a complete migration.
8271

8372
> [!NOTE]
8473
> No matter which option you select, a container named **gen1** will be created in the Gen2-enabled account, and all data from the Gen1 account will be copied to this new **gen1** container. When the migration is complete, in order to find the data on a path that existed on Gen1, you must add the prefix **gen1/** to the same path to access it on Gen2. For example, a path that was named 'FolderRoot/FolderChild/FileName.csv' on Gen1 will be available at 'gen1/FolderRoot/FolderChild/FileName.csv' on Gen2. Container names can't be renamed on Gen2, so this **gen1** container on Gen2 can't be renamed post migration. However, the data can be copied to a new container in Gen2 if needed.
8574
86-
## Choose a migration option
75+
## Step 6: Choose a migration option
8776

8877
**Option 1: Copy data only (recommended).** In this option, data is copied from Gen1 to Gen2. As the data is being copied, the Gen1 account becomes read-only. After the data is copied, both the Gen1 and Gen2 accounts will be accessible. However, you must update the applications and compute workloads to use the new Gen2 endpoint.
8978

@@ -153,7 +142,7 @@ Whichever option you choose, after you've migrated and verified that all your wo
153142
> [!div class="mx-imgBorder"]
154143
> ![Migration stop button](./media/data-lake-storage-migrate-gen1-to-gen2-azure-portal/migration-stop.png)
155144
156-
## Migrate workloads and applications
145+
## Step 7: Migrate workloads and applications
157146

158147
1. Configure [services in your workloads](./data-lake-storage-supported-azure-services.md) to point to your Gen2 endpoint. For links to articles that help you configure Azure Databricks, HDInsight, and other Azure services to use Gen2, see [Azure services that support Azure Data Lake Storage Gen2](data-lake-storage-supported-azure-services.md).
159148

0 commit comments

Comments
 (0)