Skip to content

Commit 569c2dd

Browse files
committed
1st refine
1 parent e3ba74f commit 569c2dd

File tree

2 files changed

+8
-3
lines changed

2 files changed

+8
-3
lines changed

articles/data-factory/copy-activity-data-consistency.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,12 @@ ms.author: yexu
2020

2121
When you move data from source to destination store, Azure Data Factory copy activity provides data consistency verification to ensure the data is not only successfully copied from source to destination store, but also verified to be consistent between source and destination store. Once inconsistent data have been found during the data movement, you can either abort the copy activity or continue to copy the rest by enabling fault tolerance setting to skip inconsistent data. You can get the skipped object names by enabling session log setting in copy activity.
2222

23+
> [!IMPORTANT]
24+
> This feature is currently in preview due to the limitations below:
25+
> 1. Data consistency verification is available only for binary files copy between file-based stores with 'PreserveHierarchy' behavior in copy activity.
26+
> 2. When you get the skipped inconsistent file names by enabling session log setting in copy activity, the completeness of log file can not be 100% guaranteed if copy activity failed.
27+
> 3. The session log contains inconsistent files names only, where the successfully copied files are not logged.
28+
2329
## Supported data stores
2430

2531
### Source data stores
@@ -82,7 +88,6 @@ linkedServiceName | The linked service of [Azure Blob Storage](connector-azure-b
8288
path | The path of the log file. | Specify the path that you want to store the log file. If you do not provide a path, the service creates a container for you. | No
8389

8490
>[!NOTE]
85-
>- Only binary copy between file-based stores with PreserveHierarchy copy behavior supports data consistency verification in copy activity now.
8691
>- Data consistency is not supported in staging copy scenario.
8792
>- When copying binary files to Azure Blob Storage or Azure Data Lake Storage Gen2, copy activity does both file size and MD5 checksum verification to ensure the data consistency between source and destination stores. For copying binary files to other storage stores, copy activity does file size verification to ensure the data consistency between source and destination store.
8893
@@ -113,7 +118,7 @@ After the copy activity run completes, you can get the result of data consistenc
113118
Value for **VerificationResult**:
114119
- **Verified**: Your copied data has been verified to be consistent between source and destination store.
115120
- **NotVerified**: Your copied data has not been verified to be consistent because you have not enabled the validateDataConsistency setting.
116-
- **Unsupported**: Your copied data has not been verified to be consistent because data consistency verification is not supported in this copy activity run.
121+
- **Unsupported**: Your copied data has not been verified to be consistent because data consistency verification is not supported for this copy pairs.
117122

118123
Value for **InconsistentData**:
119124
- **Found**: ADF copy activity has found Inconsistent data.

articles/data-factory/copy-activity-fault-tolerance.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ When you copy data from source to destination store, Azure Data Factory copy act
2727
- You can abort the copy activity when the first failure is encountered.
2828
- You can continue to copy the rest by enabling fault tolerance to skip the incompatible data. For example, skip the duplicated row in this case. In addition, you can log the skipped data by enabling session log in copy activity.
2929

30-
## Fault tolerance for copying binary files (Preview)
30+
## Fault tolerance for copying binary files
3131

3232
### Configuration
3333
When you copy binary files between storage stores, you can enable fault tolerance as followings:

0 commit comments

Comments
 (0)