Skip to content

Commit 1acba40

Browse files
authored
Merge pull request #205342 from Clare-Zheng82/0720-Add_dataflow_error_code
Add error codes to data flow error TSG doc
2 parents e179cfb + 72aff7b commit 1acba40

File tree

1 file changed

+26
-1
lines changed

1 file changed

+26
-1
lines changed

articles/data-factory/data-flow-troubleshoot-errors.md

Lines changed: 26 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -243,7 +243,7 @@ This article lists common error codes and messages reported by mapping data flow
243243
- **Cause**: An invalid staging configuration is provided in the Hive.
244244
- **Recommendation**: Please update the related ADLS Gen2 linked service that is used as staging. Currently, only the service principal key credential is supported.
245245

246-
- **Message**: ADLS Gen2 storage staging properties should be specified. Either one of key or tenant/spnId/spnKey or miServiceUri/miServiceToken is required.
246+
- **Message**: ADLS Gen2 storage staging properties should be specified. Either one of key or tenant/spnId/spn Credential/spnCredentialType or miServiceUri/miServiceToken is required.
247247
- **Cause**: An invalid staging configuration is provided in the Hive.
248248
- **Recommendation**: Update the related ADLS Gen2 linked service with right credentials that are used as staging in the Hive.
249249

@@ -636,6 +636,31 @@ This article lists common error codes and messages reported by mapping data flow
636636
- **Cause**: Transient error
637637
- **Recommendation**: Retry the request after a wait period.
638638

639+
## Error code: DF-Executor-OutOfMemorySparkError
640+
641+
- **Message**: The data may be too large to fit in the memory.
642+
- **Cause**: The size of the data far exceeds the limit of the node memory.
643+
- **Recommendation**: Increase the core count and switch to the memory optimized compute type.
644+
645+
## Error code: DF-SQLDW-InternalErrorUsingMSI
646+
647+
- **Message**: An internal error occurred while authenticating against Managed Service Identity in Azure Synapse Analytics instance. Please restart the Azure Synapse Analytics instance or contact Azure Synapse Analytics Dedicated SQL Pool support if this problem persists.
648+
- **Cause**: An internal error occurred in Azure Synapse Analytics.
649+
- **Recommendation**: Restart the Azure Synapse Analytics instance or contact Azure Synapse Analytics Dedicated SQL Pool support if this problem persists.
650+
651+
## Error code: DF-Executor-IncorrectLinkedServiceConfiguration
652+
653+
- **Message**: Possible causes are,
654+
- The linked service is incorrectly configured as type 'Azure Blob Storage' instead of 'Azure DataLake Storage Gen2' and it has 'Hierarchical namespace' enabled. Please create a new linked service of type 'Azure DataLake Storage Gen2' for the storage account in question.
655+
- Certain scenarios with any combinations of 'Clear the folder', non-default 'File name option', 'Key' partitioning may fail with a Blob linked service on a 'Hierarchical namespace' enabled storage account. You can disable these dataflow settings (if enabled) and try again in case you do not want to create a new Gen2 linked service.
656+
- **Cause**: Delete operation on the Azure Data Lake Storage Gen2 account failed since its linked service is incorrectly configured as Azure Blob Storage.
657+
- **Recommendation**: Create a new Azure Data Lake Storage Gen2 linked service for the storage account. If that's not feasible, some known scenarios like **Clear the folder**, non-default **File name option**, **Key** partitioning in any combinations may fail with an Azure Blob Storage linked service on a hierarchical namespace enabled storage account. You can disable these data flow settings if you enabled them and try again.
658+
659+
## Error code: DF-Delta-InvalidProtocolVersion
660+
661+
- **Message**: Unsupported Delta table protocol version, Refer https://docs.delta.io/latest/versioning.html#-table-version for versioning information.
662+
- **Cause**: Data flows don't support this version of the Delta table protocol.
663+
- **Recommendation**: Use a lower version of the Delta table protocol.
639664

640665
## Next steps
641666

0 commit comments

Comments
 (0)