You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/storage/blobs/data-lake-storage-migrate-gen1-to-gen2.md
+16-16Lines changed: 16 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -118,16 +118,19 @@ Let's take a closer look at each pattern.
118
118
119
119
This is the simplest pattern.
120
120
121
-
:one: Stop all writes to Gen1.
121
+
1. Stop all writes to Gen1.
122
122
123
-
:two: Move data from Gen1 to Gen2.
123
+
2. Move data from Gen1 to Gen2.
124
124
125
-
:three: Point ingest operations and workloads to Gen2.
125
+
3. Point ingest operations and workloads to Gen2.
126
126
127
-
:four: Decommission Gen1.
127
+
4. Decommission Gen1.
128
128
129
129

130
130
131
+
> [!TIP]
132
+
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
133
+
131
134
#### Considerations for using this pattern:
132
135
133
136
- Cutover from Gen1 to Gen2 for all workloads at the same time.
@@ -136,9 +139,6 @@ This is the simplest pattern.
136
139
137
140
- Ideal for pipelines that can afford downtime and all apps can be upgraded at one time.
138
141
139
-
> [!TIP]
140
-
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
141
-
142
142
### Incremental copy pattern
143
143
144
144
:one: Start moving data from Gen1 to Gen2.
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
156
+
154
157
#### Considerations for using this pattern:
155
158
156
159
- Cutover from Gen1 to Gen2 for all workloads at the same time.
@@ -159,9 +162,6 @@ This is the simplest pattern.
159
162
160
163
- Ideal for pipelines where all apps upgraded at one time, but the data copy requires more time.
161
164
162
-
> [!TIP]
163
-
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
179
+
177
180
#### Considerations for using this pattern:
178
181
179
182
- Gen1 and Gen2 pipelines run side-by-side.
@@ -182,9 +185,6 @@ This is the simplest pattern.
182
185
183
186
- Ideal in situations where your workloads and applications can't afford any downtime, and you can ingest into both storage accounts.
184
187
185
-
> [!TIP]
186
-
> For data transfer, we recommend [Azure Data Factory](https://docs.microsoft.com/azure/data-factory/connector-azure-data-lake-storage). ACLs copy with the data.
187
-
188
188
### Bi-directional sync pattern
189
189
190
190
This pattern is similar to the *dual pipeline* pattern, but it's more ideally suited for complicated pipelines that require Gen1 and Gen2 side-by-side support during migration.
@@ -199,15 +199,15 @@ This pattern is similar to the *dual pipeline* pattern, but it's more ideally su
> For bidirectional data transfer, we recommend [WanDisco](https://docs.wandisco.com/bigdata/wdfusion/adls/). It offers a repair feature for existing data.
204
+
202
205
#### Considerations for using this pattern:
203
206
204
207
- Ideal for complex scenarios that involve a large number of pipelines and dependencies where a phased approach might make more sense.
205
208
206
209
- Migration effort is high, but it provides side-by-side support for Gen1 and Gen2.
207
210
208
-
> [!TIP]
209
-
> For bidirectional data transfer, we recommend [WanDisco](https://docs.wandisco.com/bigdata/wdfusion/adls/). It offers a repair feature for existing data.
210
-
211
211
## Next steps
212
212
213
213
- Learn about the various parts of setting up security for a storage account. See [Azure Storage security guide](../common/storage-security-guide.md).
0 commit comments