Skip to content

Commit d3f61ae

Browse files
committed
Update data flow TSG
1 parent cf097aa commit d3f61ae

File tree

1 file changed

+45
-4
lines changed

1 file changed

+45
-4
lines changed

articles/data-factory/data-flow-troubleshoot-guide.md

Lines changed: 45 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: data-factory
88
ms.subservice: data-flows
99
ms.custom: ignite-2022
1010
ms.topic: troubleshooting
11-
ms.date: 09/29/2022
11+
ms.date: 11/02/2022
1212
---
1313

1414
# Troubleshoot mapping data flows in Azure Data Factory
@@ -194,6 +194,13 @@ This section lists common error codes and messages reported by mapping data flow
194194
- **Cause**: The short data type is not supported in the Azure Cosmos DB instance.
195195
- **Recommendation**: Add a derived column transformation to convert related columns from short to integer before using them in the Azure Cosmos DB sink transformation.
196196

197+
### Error code: DF-CSVWriter-InvalidQuoteSetting
198+
199+
- **Message**: Job failed while writing data with error: Quote character and escape character cannot be empty if column value contains column delimiter
200+
- **Cause**: Both quote characters and esca
201+
pe characters are empty when column value contains column delimiter.
202+
- **Recommendation**: Set your quote character or escape character.
203+
197204
### Error code: DF-Delimited-ColumnDelimiterMissed
198205

199206
- **Message**: Column delimiter is required for parse.
@@ -213,7 +220,7 @@ This section lists common error codes and messages reported by mapping data flow
213220
- **Recommendation**: Set the timestamp or version in the delta settings.
214221

215222
### Error code: DF-Delta-InvalidProtocolVersion
216-
223+
F-D
217224
- **Message**: Unsupported Delta table protocol version, Refer https://docs.delta.io/latest/versioning.html#-table-version for versioning information.
218225
- **Cause**: Data flows don't support this version of the Delta table protocol.
219226
- **Recommendation**: Use a lower version of the Delta table protocol.
@@ -230,6 +237,17 @@ This section lists common error codes and messages reported by mapping data flow
230237
- **Cause**: Key column(s) are missed for non-insertable operations.
231238
- **Recommendation**: Specify key column(s) on delta sink to have non-insertable operations.
232239

240+
### Error code: DF-Dynamics-InvalidNullAlternateKeyColumn
241+
242+
- **Message**: Any column value of alternate Key can't be NULL.
243+
- **Cause**: Your alternate key column value can't be null.
244+
- **Recommendation**: Confirm that your column value of your alternate key is not NULL.
245+
246+
### Error code: DF-Dynamics-TooMuchAlternateKey
247+
248+
- **Cause**: One lookup field with more than one alternate key reference is not valid.
249+
- **Recommendation**: Check your schema mapping and confirm that each lookup field has a single alternate key.
250+
233251
### Error code: DF-Excel-DifferentSchemaNotSupport
234252

235253
- **Message**: Read excel files with different schema is not supported now.
@@ -479,6 +497,20 @@ This section lists common error codes and messages reported by mapping data flow
479497
- **Cause**: Possible problems with the JSON file: unsupported encoding, corrupt bytes, or using JSON source as a single document on many nested lines.
480498
- **Recommendation**: Verify that the JSON file's encoding is supported. On the source transformation that's using a JSON dataset, expand **JSON Settings** and turn on **Single Document**.
481499

500+
### Error code: DF-Executor-UnauthorizedStorageAccess
501+
502+
- **Cause**: You are not permitted to access the storage account either due to missing roles for managed identity/service principal authentication or network firewall settings.
503+
- **Recommendation**: When using managed identity/service principal authentication,
504+
1. For source: In Storage Explorer, grant the managed identity/service principal at least **Execute** permission for ALL upstream folders and the file system, along with **Read** permission for the files to copy. Alternatively, in Access control (IAM), grant the managed identity/service principal at least the **Storage Blob Data Reader** role.
505+
2. For sink: In Storage Explorer, grant the managed identity/service principal at least **Execute** permission for ALL upstream folders and the file system, along with **Write** permission for the sink folder. Alternatively, in Access control (IAM), grant the managed identity/service principal at least the **Storage Blob Data Contributor** role.
506+
Also please ensure that the network firewall settings in the storage account are configured correctly, as turning on firewall rules for your storage account blocks incoming requests for data by default, unless the requests originate from a service operating within an Azure Virtual Network (VNet) or from allowed public IP addresses.
507+
508+
### Error code: DF-Executor-UnreachableStorageAccount
509+
510+
- **Message**: System is not able to resolve the IP address of the host. Please verify that your host name is correct or check if your DNS server can resolve the host to an IP address successfully
511+
- **Cause**: Unable to reach the given storage account.
512+
- **Recommendation**: Check the name of the storage account and make sure the storage account exists.
513+
482514
### Error code: DF-File-InvalidSparkFolder
483515

484516
- **Message**: Failed to read footer for file.
@@ -602,8 +634,6 @@ This section lists common error codes and messages reported by mapping data flow
602634
- **Cause**: SQL server configuration error.
603635
- **Recommendations**: Install a trusted certificate on your SQL server, or change `encrypt` connection string setting to false and `trustServerCertificate` connection string setting to true.
604636

605-
606-
607637
### Error code: DF-PGSQL-InvalidCredential
608638

609639
- **Message**: User/password should be specified.
@@ -631,6 +661,17 @@ This section lists common error codes and messages reported by mapping data flow
631661
| Your context value can't be empty when reading data. | Specify the context. |
632662
| Your context value can't be empty when browsing object names. | Specify the context. |
633663

664+
### Error code: DF-SAPODP-DataflowSystemError
665+
666+
- **Recommendation**: Reconfigure the activity and run it again. If the issue persists, you can contact Microsoft support for further assistance.
667+
668+
### Error code: DF-SAPODP-DataParsingFailed
669+
670+
- **Cause**: Mostly you have hidden column settings in your SAP table. When you use SAP mapping data flow to read data from SAP server, it returns all the schema (columns, including hidden ones), but returned data do not contain related values. So, data misalignment happened and lead to parse value issue or wrong data value issue.
671+
- **Recommendation**: There are two solutions for this issue:
672+
1. Remove hidden settings from the related column(s) through SAP GUI.
673+
2. If you want to keep existed SAP settings unchanged, use hidden feature (manually add DSL property `enableProjection:true` in script) in SAP mapping data flow to filter the hidden column(s) and continue to read data.
674+
634675
### Error code: DF-SAPODP-ObjectInvalid
635676

636677
- **Cause**: The object name is not found or not released.

0 commit comments

Comments
 (0)