Skip to content

Commit 7604d42

Browse files
committed
Add support for preserve ACL between Gen2
1 parent 8cb36e0 commit 7604d42

File tree

2 files changed

+14
-14
lines changed

2 files changed

+14
-14
lines changed

articles/data-factory/connector-azure-data-lake-storage.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.service: data-factory
1010
ms.workload: data-services
1111
ms.topic: conceptual
1212
ms.custom: seo-lt-2019
13-
ms.date: 02/17/2020
13+
ms.date: 03/24/2020
1414
---
1515

1616
# Copy and transform data in Azure Data Lake Storage Gen2 using Azure Data Factory
@@ -34,7 +34,7 @@ For Copy activity, with this connector you can:
3434
- Copy data from/to Azure Data Lake Storage Gen2 by using account key, service principal, or managed identities for Azure resources authentications.
3535
- Copy files as-is or parse or generate files with [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md).
3636
- [Preserve file metadata during copy](#preserve-metadata-during-copy).
37-
- [Preserve ACLs](#preserve-metadata-during-copy) when copying from Azure Data Lake Storage Gen1.
37+
- [Preserve ACLs](#preserve-acls) when copying from Azure Data Lake Storage Gen1/Gen2.
3838

3939
>[!IMPORTANT]
4040
>If you enable the **Allow trusted Microsoft services to access this storage account** option on Azure Storage firewall settings and want to use Azure integration runtime to connect to your Data Lake Storage Gen2, you must use [managed identity authentication](#managed-identity) for ADLS Gen2.
@@ -375,13 +375,13 @@ This section describes the resulting behavior of the copy operation for differen
375375

376376
When you copy files from Amazon S3/Azure Blob/Azure Data Lake Storage Gen2 to Azure Data Lake Storage Gen2/Azure Blob, you can choose to preserve the file metadata along with data. Learn more from [Preserve metadata](copy-activity-preserve-metadata.md#preserve-metadata).
377377

378-
## Preserve ACLs from Data Lake Storage Gen1
378+
## <a name="preserve-acls"></a> Preserve ACLs from Data Lake Storage Gen1/Gen2
379+
380+
When you copy files from Azure Data Lake Storage Gen1/Gen2 to Gen2, you can choose to preserve the POSIX access control lists (ACLs) along with data. Learn more from [Preserve ACLs from Data Lake Storage Gen1/Gen2 to Gen2](copy-activity-preserve-metadata.md#preserve-acls).
379381

380382
>[!TIP]
381383
>To copy data from Azure Data Lake Storage Gen1 into Gen2 in general, see [Copy data from Azure Data Lake Storage Gen1 to Gen2 with Azure Data Factory](load-azure-data-lake-storage-gen2-from-gen1.md) for a walk-through and best practices.
382384
383-
When you copy files from Azure Data Lake Storage Gen1 to Gen2, you can choose to preserve the POSIX access control lists (ACLs) along with data. Learn more from [Preserve ACLs from Data Lake Storage Gen1 to Gen2](copy-activity-preserve-metadata.md#preserve-acls).
384-
385385
## Mapping data flow properties
386386

387387
When transforming data in mapping data flow, you can read and write files from Azure Data Lake Storage Gen2 in JSON, Avro, Delimited Text, or Parquet format. For more information, see [source transformation](data-flow-source.md) and [sink transformation](data-flow-sink.md) in the mapping data flow feature.

articles/data-factory/copy-activity-preserve-metadata.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.reviewer: douglasl
1010
ms.service: data-factory
1111
ms.workload: data-services
1212
ms.topic: conceptual
13-
ms.date: 12/12/2019
13+
ms.date: 03/24/2020
1414
ms.author: jingwang
1515

1616
---
@@ -36,7 +36,7 @@ Here's an example of copy activity JSON configuration (see `preserve`):
3636
```json
3737
"activities":[
3838
{
39-
"name": "CopyFromGen1ToGen2",
39+
"name": "CopyAndPreserveMetadata",
4040
"type": "Copy",
4141
"typeProperties": {
4242
"source": {
@@ -72,9 +72,9 @@ Here's an example of copy activity JSON configuration (see `preserve`):
7272
]
7373
```
7474

75-
## <a name="preserve-acls"></a> Preserve ACLs from Data Lake Storage Gen1 to Gen2
75+
## <a name="preserve-acls"></a> Preserve ACLs from Data Lake Storage Gen1/Gen2 to Gen2
7676

77-
When you upgrade from Azure Data Lake Storage Gen1 to Gen2, you can choose to preserve the POSIX access control lists (ACLs) along with data files. For more information on access control, see [Access control in Azure Data Lake Storage Gen1](../data-lake-store/data-lake-store-access-control.md) and [Access control in Azure Data Lake Storage Gen2](../storage/blobs/data-lake-storage-access-control.md).
77+
When you upgrade from Azure Data Lake Storage Gen1 to Gen2 or copy data between ADLS Gen2, you can choose to preserve the POSIX access control lists (ACLs) along with data files. For more information on access control, see [Access control in Azure Data Lake Storage Gen1](../data-lake-store/data-lake-store-access-control.md) and [Access control in Azure Data Lake Storage Gen2](../storage/blobs/data-lake-storage-access-control.md).
7878

7979
Copy activity supports preserving the following types of ACLs during data copy. You can select one or more types:
8080

@@ -85,21 +85,21 @@ Copy activity supports preserving the following types of ACLs during data copy.
8585
If you specify to copy from a folder, Data Factory replicates the ACLs for that given folder and the files and directories under it, if `recursive` is set to true. If you specify to copy from a single file, the ACLs on that file are copied.
8686

8787
>[!NOTE]
88-
>When you use ADF to preserve ACLs from Data Lake Storage Gen1 to Gen2, the existing ACLs on Gen2's corresponding folder/files will be overwritten.
88+
>When you use ADF to preserve ACLs from Data Lake Storage Gen1/Gen2 to Gen2, the existing ACLs on sink Gen2's corresponding folder/files will be overwritten.
8989
9090
>[!IMPORTANT]
9191
>When you choose to preserve ACLs, make sure you grant high enough permissions for Data Factory to operate against your sink Data Lake Storage Gen2 account. For example, use account key authentication or assign the Storage Blob Data Owner role to the service principal or managed identity.
9292
93-
When you configure source as Data Lake Storage Gen1 with binary format or the binary copy option, and sink as Data Lake Storage Gen2 with binary format or the binary copy option, you can find the **Preserve** option on the **Settings** page in Copy Data Tool or on the **Copy Activity** > **Settings** tab for activity authoring.
93+
When you configure source as Data Lake Storage Gen1/Gen2 with binary format or the binary copy option, and sink as Data Lake Storage Gen2 with binary format or the binary copy option, you can find the **Preserve** option on the **Settings** page in Copy Data Tool or on the **Copy Activity** > **Settings** tab for activity authoring.
9494

95-
![Data Lake Storage Gen1 to Gen2 Preserve ACL](./media/connector-azure-data-lake-storage/adls-gen2-preserve-acl.png)
95+
![Data Lake Storage Gen1/Gen2 to Gen2 Preserve ACL](./media/connector-azure-data-lake-storage/adls-gen2-preserve-acl.png)
9696

9797
Here's an example of copy activity JSON configuration (see `preserve`):
9898

9999
```json
100100
"activities":[
101101
{
102-
"name": "CopyFromGen1ToGen2",
102+
"name": "CopyAndPreserveACLs",
103103
"type": "Copy",
104104
"typeProperties": {
105105
"source": {
@@ -123,7 +123,7 @@ Here's an example of copy activity JSON configuration (see `preserve`):
123123
},
124124
"inputs": [
125125
{
126-
"referenceName": "<Binary dataset name for Azure Data Lake Storage Gen1 source>",
126+
"referenceName": "<Binary dataset name for Azure Data Lake Storage Gen1/Gen2 source>",
127127
"type": "DatasetReference"
128128
}
129129
],

0 commit comments

Comments
 (0)