Skip to content

Commit fce6bd6

Browse files
authored
Merge pull request #98886 from linda33wj/master
Update ADF copy content
2 parents db74783 + 0b6048f commit fce6bd6

12 files changed

+220
-59
lines changed

articles/data-factory/TOC.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@
121121
items:
122122
- name: Copy from Data Lake Storage Gen1
123123
href: load-azure-data-lake-storage-gen2-from-gen1.md
124-
- name: Load SQL Data Warehouse
124+
- name: Load Synapse Analytics (formerly SQL Data Warehouse)
125125
href: load-azure-sql-data-warehouse.md
126126
- name: Load Data Lake Storage Gen1
127127
href: load-azure-data-lake-store.md
@@ -233,7 +233,7 @@
233233
href: connector-azure-sql-database.md
234234
- name: Azure SQL Database Managed Instance
235235
href: connector-azure-sql-database-managed-instance.md
236-
- name: Azure SQL Data Warehouse
236+
- name: Azure Synapse Analytics (formerly SQL Data Warehouse)
237237
href: connector-azure-sql-data-warehouse.md
238238
- name: Azure Table Storage
239239
href: connector-azure-table-storage.md

articles/data-factory/connector-amazon-simple-storage-service.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.service: data-factory
1010
ms.workload: data-services
1111
ms.topic: conceptual
1212
ms.custom: seo-lt-2019
13-
ms.date: 12/10/2019
13+
ms.date: 12/13/2019
1414
---
1515

1616
# Copy data from Amazon Simple Storage Service using Azure Data Factory
@@ -33,7 +33,7 @@ This Amazon S3 connector is supported for the following activities:
3333
- [GetMetadata activity](control-flow-get-metadata-activity.md)
3434
- [Delete activity](delete-activity.md)
3535

36-
Specifically, this Amazon S3 connector supports copying files as-is or parsing files with the [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md). It uses [AWS Signature Version 4](https://docs.aws.amazon.com/general/latest/gr/signature-version-4.html) to authenticate requests to S3.
36+
Specifically, this Amazon S3 connector supports copying files as-is or parsing files with the [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md). You can also choose to [Preserve file metadata during copy](#preserve-metadata-during-copy). The connector uses [AWS Signature Version 4](https://docs.aws.amazon.com/general/latest/gr/signature-version-4.html) to authenticate requests to S3.
3737

3838
>[!TIP]
3939
>You can use this Amazon S3 connector to copy data from **any S3-compatible storage providers** e.g. [Google Cloud Storage](connector-google-cloud-storage.md). Specify the corresponding service URL in the linked service configuration.

articles/data-factory/connector-azure-blob-storage.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@ For Copy activity, this Blob storage connector supports:
3838
- Copying blobs by using account key, service shared access signature, service principal or managed identities for Azure resources authentications.
3939
- Copying blobs from block, append, or page blobs and copying data to only block blobs.
4040
- Copying blobs as is or parsing or generating blobs with [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md).
41+
- [Preserve file metadata during copy](#preserve-metadata-during-copy).
4142

4243
>[!IMPORTANT]
4344
>If you enable the **Allow trusted Microsoft services to access this storage account** option on Azure Storage firewall settings and want to use Azure integration runtime to connect to your Blob Storage, you must use [managed identity authentication](#managed-identity).

articles/data-factory/connector-azure-data-lake-storage.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ms.service: data-factory
1010
ms.workload: data-services
1111
ms.topic: conceptual
1212
ms.custom: seo-lt-2019
13-
ms.date: 12/10/2019
13+
ms.date: 12/13/2019
1414
---
1515

1616
# Copy and transform data in Azure Data Lake Storage Gen2 using Azure Data Factory
@@ -33,6 +33,8 @@ For Copy activity, with this connector you can:
3333

3434
- Copy data from/to Azure Data Lake Storage Gen2 by using account key, service principal, or managed identities for Azure resources authentications.
3535
- Copy files as-is or parse or generate files with [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md).
36+
- [Preserve file metadata during copy](#preserve-metadata-during-copy).
37+
- [Preserve ACLs](#preserve-metadata-during-copy) when copying from Azure Data Lake Storage Gen1.
3638

3739
>[!IMPORTANT]
3840
>If you enable the **Allow trusted Microsoft services to access this storage account** option on Azure Storage firewall settings and want to use Azure integration runtime to connect to your Data Lake Storage Gen2, you must use [managed identity authentication](#managed-identity) for ADLS Gen2.

articles/data-factory/connector-azure-data-lake-store.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ Specifically, with this connector you can:
3535

3636
- Copy files by using one of the following methods of authentication: service principal or managed identities for Azure resources.
3737
- Copy files as is or parse or generate files with the [supported file formats and compression codecs](supported-file-formats-and-compression-codecs.md).
38+
- [Preserve ACLs](#preserve-acls-to-data-lake-storage-gen2) when copying into Azure Data Lake Storage Gen2.
3839

3940
> [!IMPORTANT]
4041
> If you copy data by using the self-hosted integration runtime, configure the corporate firewall to allow outbound traffic to `<ADLS account name>.azuredatalakestore.net` and `login.microsoftonline.com/<tenant>/oauth2/token` on port 443. The latter is the Azure Security Token Service that the integration runtime needs to communicate with to get the access token.
@@ -318,7 +319,10 @@ This section describes the resulting behavior of the copy operation for differen
318319

319320
## Preserve ACLs to Data Lake Storage Gen2
320321

321-
If you want to replicate the access control lists (ACLs) along with data files when you upgrade from Data Lake Storage Gen1 to Data Lake Storage Gen2, see [Preserve ACLs from Data Lake Storage Gen1](connector-azure-data-lake-storage.md#preserve-acls-from-data-lake-storage-gen1).
322+
>[!TIP]
323+
>To copy data from Azure Data Lake Storage Gen1 into Gen2 in general, see [Copy data from Azure Data Lake Storage Gen1 to Gen2 with Azure Data Factory](load-azure-data-lake-storage-gen2-from-gen1.md) for a walk-through and best practices.
324+
325+
If you want to replicate the access control lists (ACLs) along with data files when you upgrade from Data Lake Storage Gen1 to Data Lake Storage Gen2, see [Preserve ACLs from Data Lake Storage Gen1](copy-activity-preserve-metadata.md#preserve-acls).
322326

323327
## Mapping data flow properties
324328

0 commit comments

Comments
 (0)