Skip to content

Commit 886565d

Browse files
committed
Update and add error code
1 parent c1817a1 commit 886565d

File tree

1 file changed

+32
-5
lines changed

1 file changed

+32
-5
lines changed

articles/data-factory/data-flow-troubleshoot-guide.md

Lines changed: 32 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: data-factory
88
ms.subservice: data-flows
99
ms.custom: ignite-2022
1010
ms.topic: troubleshooting
11-
ms.date: 11/02/2022
11+
ms.date: 03/28/2023
1212
---
1313

1414
# Troubleshoot mapping data flows in Azure Data Factory
@@ -330,7 +330,7 @@ This section lists common error codes and messages reported by mapping data flow
330330
- **Cause**: Broadcast has a default timeout of 60 seconds in debug runs and 300 seconds in job runs. On the broadcast join, the stream chosen for broadcast is too large to produce data within this limit. If a broadcast join isn't used, the default broadcast by dataflow can reach the same limit.
331331
- **Recommendation**: Turn off the broadcast option or avoid broadcasting large data streams for which the processing can take more than 60 seconds. Choose a smaller stream to broadcast. Large Azure SQL Data Warehouse tables and source files aren't typically good choices. In the absence of a broadcast join, use a larger cluster if this error occurs.
332332

333-
### Error code: DF-Executor-ColumnUnavailable
333+
### Error code: DF-Executor-ColumnNotFound
334334

335335
- **Message**: Column name used in expression is unavailable or invalid.
336336
- **Cause**: An invalid or unavailable column name is used in an expression.
@@ -440,7 +440,7 @@ This section lists common error codes and messages reported by mapping data flow
440440
- **Cause**: The size of the data far exceeds the limit of the node memory.
441441
- **Recommendation**: Increase the core count and switch to the memory optimized compute type.
442442

443-
### Error code: DF-Executor-ParseError
443+
### Error code: DF-Executor-ExpressionParseError
444444

445445
- **Message**: Expression cannot be parsed.
446446
- **Cause**: An expression generated parsing errors because of incorrect formatting.
@@ -517,6 +517,33 @@ This section lists common error codes and messages reported by mapping data flow
517517
- **Cause**: Privileged access approval is needed to copy data. It's a user configuration issue.
518518
- **Recommendation**: Ask the tenant admin to approve your **Data Access Request** in Office365 in privileged access management (PAM) module.
519519

520+
### Error code: DF-Executor-DSLParseError
521+
522+
- **Message**: Data flow script cannot be parsed.
523+
- **Cause**: The data flow script has parsing errors.
524+
- **Recommendation**: Check for errors (example: missing symbol(s), unwanted symbol(s)) near mentioned line number(s) in the data flow script.
525+
526+
### Error code: DF-Executor-IncorrectQuery
527+
528+
- **Message**: Admin Consent is pending.
529+
- **Cause**: The query submitted was syntactically incorrect.
530+
- **Recommendation**: Check the syntactical correctness of the given query. Ensure to have a non-quoted query string when it is referenced as a pipeline parameter.
531+
532+
### Error code: DF-Executor-ParameterParseError
533+
- **Message**: Parameter stream has parsing errors. Not honoring the datatype of parameter(s) could be one of the causes.
534+
- **Cause**: Parsing errors in given parameter(s).
535+
- **Recommendation**: Check the parameter(s) having errors and ensure usage of appropriate function(s), if any, to honor the datatype(s) given.
536+
537+
### Error code: DF-MICROSOFT365-CONSENTPENDING
538+
- **Message**: Admin Consent is pending.
539+
- **Cause**: Admin Consent is missing.
540+
- **Recommendation**: Provide the consent and then rerun the pipeline. To provide consent, refer to this link [How can I approve PAM requests via the Microsoft 365 admin center](https://learn.microsoft.com/graph/data-connect-faq#how-can-i-approve-pam-requests-via-the-microsoft-365-admin-center).
541+
542+
### Error code: 127
543+
- **Message**: The spark job of Dataflow completed, but the runtime state is either null or still InProgress..
544+
- **Cause**: Transient issue with microservices involved in the execution can cause the run to fail.
545+
- **Recommendation**: Refer to this link [scenario 3 transient issues](#scenario-3-transient-issues).
546+
520547
### Error code: DF-File-InvalidSparkFolder
521548

522549
- **Message**: Failed to read footer for file.
@@ -525,7 +552,7 @@ This section lists common error codes and messages reported by mapping data flow
525552

526553
### Error code: DF-GEN2-InvalidAccountConfiguration
527554

528-
- **Message**: Either one of account key or tenant/spnId/spnCredential/spnCredentialType or miServiceUri/miServiceToken should be specified.
555+
- **Message**: Either one of account key or SAS token or tenant/spnId/spnCredential/spnCredentialType or userAuth or miServiceUri/miServiceToken should be specified.
529556
- **Cause**: An invalid credential is provided in the ADLS Gen2 linked service.
530557
- **Recommendation**: Update the ADLS Gen2 linked service to have the right credential configuration.
531558

@@ -589,7 +616,7 @@ This section lists common error codes and messages reported by mapping data flow
589616

590617
### Error code: DF-JSON-WrongDocumentForm
591618

592-
- **Message**: Malformed records are detected in schema inference. Parse Mode: FAILFAST.
619+
- **Message**: Malformed records are detected in schema inference. Parse Mode: FAILFAST. It could be because of a wrong selection in document form to parse json file(s). Please try a different 'Document form' (Single document/Document per line/Array of documents) on the json source.
593620
- **Cause**: Wrong document form is selected to parse JSON file(s).
594621
- **Recommendation**: Try different **Document form** (**Single document**/**Document per line**/**Array of documents**) in JSON settings. Most cases of parsing errors are caused by wrong configuration.
595622

0 commit comments

Comments
 (0)