You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/data-flow-troubleshoot-guide.md
+32-5Lines changed: 32 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.service: data-factory
8
8
ms.subservice: data-flows
9
9
ms.custom: ignite-2022
10
10
ms.topic: troubleshooting
11
-
ms.date: 11/02/2022
11
+
ms.date: 03/28/2023
12
12
---
13
13
14
14
# Troubleshoot mapping data flows in Azure Data Factory
@@ -330,7 +330,7 @@ This section lists common error codes and messages reported by mapping data flow
330
330
-**Cause**: Broadcast has a default timeout of 60 seconds in debug runs and 300 seconds in job runs. On the broadcast join, the stream chosen for broadcast is too large to produce data within this limit. If a broadcast join isn't used, the default broadcast by dataflow can reach the same limit.
331
331
-**Recommendation**: Turn off the broadcast option or avoid broadcasting large data streams for which the processing can take more than 60 seconds. Choose a smaller stream to broadcast. Large Azure SQL Data Warehouse tables and source files aren't typically good choices. In the absence of a broadcast join, use a larger cluster if this error occurs.
332
332
333
-
### Error code: DF-Executor-ColumnUnavailable
333
+
### Error code: DF-Executor-ColumnNotFound
334
334
335
335
-**Message**: Column name used in expression is unavailable or invalid.
336
336
-**Cause**: An invalid or unavailable column name is used in an expression.
@@ -440,7 +440,7 @@ This section lists common error codes and messages reported by mapping data flow
440
440
-**Cause**: The size of the data far exceeds the limit of the node memory.
441
441
-**Recommendation**: Increase the core count and switch to the memory optimized compute type.
442
442
443
-
### Error code: DF-Executor-ParseError
443
+
### Error code: DF-Executor-ExpressionParseError
444
444
445
445
-**Message**: Expression cannot be parsed.
446
446
-**Cause**: An expression generated parsing errors because of incorrect formatting.
@@ -517,6 +517,33 @@ This section lists common error codes and messages reported by mapping data flow
517
517
-**Cause**: Privileged access approval is needed to copy data. It's a user configuration issue.
518
518
-**Recommendation**: Ask the tenant admin to approve your **Data Access Request** in Office365 in privileged access management (PAM) module.
519
519
520
+
### Error code: DF-Executor-DSLParseError
521
+
522
+
-**Message**: Data flow script cannot be parsed.
523
+
-**Cause**: The data flow script has parsing errors.
524
+
-**Recommendation**: Check for errors (example: missing symbol(s), unwanted symbol(s)) near mentioned line number(s) in the data flow script.
525
+
526
+
### Error code: DF-Executor-IncorrectQuery
527
+
528
+
-**Message**: Admin Consent is pending.
529
+
-**Cause**: The query submitted was syntactically incorrect.
530
+
-**Recommendation**: Check the syntactical correctness of the given query. Ensure to have a non-quoted query string when it is referenced as a pipeline parameter.
531
+
532
+
### Error code: DF-Executor-ParameterParseError
533
+
-**Message**: Parameter stream has parsing errors. Not honoring the datatype of parameter(s) could be one of the causes.
534
+
-**Cause**: Parsing errors in given parameter(s).
535
+
-**Recommendation**: Check the parameter(s) having errors and ensure usage of appropriate function(s), if any, to honor the datatype(s) given.
536
+
537
+
### Error code: DF-MICROSOFT365-CONSENTPENDING
538
+
-**Message**: Admin Consent is pending.
539
+
-**Cause**: Admin Consent is missing.
540
+
-**Recommendation**: Provide the consent and then rerun the pipeline. To provide consent, refer to this link [How can I approve PAM requests via the Microsoft 365 admin center](https://learn.microsoft.com/graph/data-connect-faq#how-can-i-approve-pam-requests-via-the-microsoft-365-admin-center).
541
+
542
+
### Error code: 127
543
+
-**Message**: The spark job of Dataflow completed, but the runtime state is either null or still InProgress..
544
+
-**Cause**: Transient issue with microservices involved in the execution can cause the run to fail.
545
+
-**Recommendation**: Refer to this link [scenario 3 transient issues](#scenario-3-transient-issues).
546
+
520
547
### Error code: DF-File-InvalidSparkFolder
521
548
522
549
-**Message**: Failed to read footer for file.
@@ -525,7 +552,7 @@ This section lists common error codes and messages reported by mapping data flow
-**Message**: Either one of account key or tenant/spnId/spnCredential/spnCredentialType or miServiceUri/miServiceToken should be specified.
555
+
-**Message**: Either one of account key or SAS token or tenant/spnId/spnCredential/spnCredentialType or userAuth or miServiceUri/miServiceToken should be specified.
529
556
-**Cause**: An invalid credential is provided in the ADLS Gen2 linked service.
530
557
-**Recommendation**: Update the ADLS Gen2 linked service to have the right credential configuration.
531
558
@@ -589,7 +616,7 @@ This section lists common error codes and messages reported by mapping data flow
589
616
590
617
### Error code: DF-JSON-WrongDocumentForm
591
618
592
-
-**Message**: Malformed records are detected in schema inference. Parse Mode: FAILFAST.
619
+
-**Message**: Malformed records are detected in schema inference. Parse Mode: FAILFAST. It could be because of a wrong selection in document form to parse json file(s). Please try a different 'Document form' (Single document/Document per line/Array of documents) on the json source.
593
620
-**Cause**: Wrong document form is selected to parse JSON file(s).
594
621
-**Recommendation**: Try different **Document form** (**Single document**/**Document per line**/**Array of documents**) in JSON settings. Most cases of parsing errors are caused by wrong configuration.
0 commit comments