You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/data-factory-troubleshoot-guide.md
+19-17Lines changed: 19 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -195,7 +195,7 @@ The following table applies to U-SQL.
195
195
196
196
-**Recommendation**: The job was submitted to Data Lake Analytics, and the script there, both failed. Investigate in Data Lake Analytics. In the portal, go to the Data Lake Analytics account and look for the job by using the Data Factory activity run ID (don't use the pipeline run ID). The job there provides more information about the error, and will help you troubleshoot.
197
197
198
-
If the resolution isn't clear, contact the Data Lake Analytics support team and provide the job Universal Resource Locater (URL), which includes your account name and the job ID.
198
+
If the resolution isn't clear, contact the Data Lake Analytics support team and provide the job Universal Resource Locator (URL), which includes your account name and the job ID.
199
199
200
200
## Azure functions
201
201
@@ -553,7 +553,7 @@ The following table applies to Azure Batch.
553
553
554
554
-**Message**: `Failed to prepare cluster for LinkedService '%linkedServiceName;', the current resource status is '%status;'.`
555
555
556
-
-**Cause**: There was an error when creating the HDI ondemand cluster.
556
+
-**Cause**: There was an error when creating the HDI on-demand cluster.
557
557
558
558
-**Recommendation**: Contact ADF support for further assistance.
559
559
@@ -563,7 +563,7 @@ The following table applies to Azure Batch.
563
563
564
564
-**Cause**: There was an internal problem with the service that caused this error.
565
565
566
-
-**Recommendation**: This could be a transient issue. Retry your job, and if the problem persists, contact the ADF support for further assistance.
566
+
-**Recommendation**: This issue could be transient. Retry your job, and if the problem persists, contact the ADF support for further assistance.
567
567
568
568
### Error code: 207
569
569
@@ -617,7 +617,7 @@ The following table applies to Azure Batch.
617
617
618
618
-**Recommendation**: A 502 error often occurs when your Ambari Server process was shut down. You can restart the Ambari Services by rebooting the head node.
619
619
620
-
1. Connect to one of your nodes on Hdinsight using SSH.
620
+
1. Connect to one of your nodes on HDInsight using SSH.
621
621
1. Identify your active head node host by running `ping headnodehost`.
622
622
1. Connect to your active head node as Ambari Server sits on the active head node using SSH.
623
623
1. Reboot the active head node.
@@ -642,7 +642,7 @@ The following table applies to Azure Batch.
642
642
643
643
-**Cause**: HDInsight cluster or service has issues.
644
644
645
-
-**Recommendation**: This error occurs when ADF doesn't receive a response from HDInsight cluster when attempting to request the status of the running job. This might be an issue on the cluster itself, or HDInsight service might have an outage.
645
+
-**Recommendation**: This error occurs when ADF doesn't receive a response from HDInsight cluster when attempting to request the status of the running job. This issue might be on the cluster itself, or HDInsight service might have an outage.
646
646
647
647
Refer to HDInsight troubleshooting documentation at https://docs.microsoft.com/azure/hdinsight/hdinsight-troubleshoot-guide, or contact their support for further assistance.
648
648
@@ -660,12 +660,12 @@ The following table applies to Azure Batch.
660
660
1. For more information on alerts and resolutions to alerts, see [Managing and Monitoring a Cluster](https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/managing-and-monitoring-ambari/content/amb_predefined_alerts.html).
661
661
1. Review your YARN memory. If your YARN memory is high, the processing of your jobs may be delayed. If you do not have enough resources to accommodate your Spark application/job, scale up the cluster to ensure the cluster has enough memory and cores.
662
662
1. Run a Sample test job.
663
-
1. If you run the same job on Hdinsight backend, check that it succeeded. For examples of sample runs, see [Run the MapReduce examples included in HDInsight](https://docs.microsoft.com/azure/hdinsight/hadoop/apache-hadoop-run-samples-linux)
664
-
1. If the job still failed on HDinsight, check the application logs and information, which to provide to Support:
663
+
1. If you run the same job on HDInsight backend, check that it succeeded. For examples of sample runs, see [Run the MapReduce examples included in HDInsight](https://docs.microsoft.com/azure/hdinsight/hadoop/apache-hadoop-run-samples-linux)
664
+
1. If the job still failed on HDInsight, check the application logs and information, which to provide to Support:
665
665
1. Check whether the job was submitted to YARN. If the job wasn't submitted to yarn, use `--master yarn`.
666
666
1. If the application finished execution, collect the start time and end time of the YARN Application. If the application didn't complete the execution, collect Start time/Launch time.
667
667
1. Check and collect application log with `yarn logs -applicationId <Insert_Your_Application_ID>`.
668
-
1. Check and collect the yarn resource manager logs under the `/var/log/hadoop-yarn/yarn` directory.
668
+
1. Check and collect the yarn Resource Manager logs under the `/var/log/hadoop-yarn/yarn` directory.
669
669
1. If these steps are not enough to resolve the issue, contact Azure HDInsight team for support and provide the above logs and timestamps.
670
670
671
671
### Error code: 2303
@@ -682,12 +682,12 @@ The following table applies to Azure Batch.
682
682
1. For more information on alerts and resolutions to alerts, see [Managing and Monitoring a Cluster](https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/managing-and-monitoring-ambari/content/amb_predefined_alerts.html).
683
683
1. Review your YARN memory. If your YARN memory is high, the processing of your jobs may be delayed. If you do not have enough resources to accommodate your Spark application/job, scale up the cluster to ensure the cluster has enough memory and cores.
684
684
1. Run a Sample test job.
685
-
1. If you run the same job on Hdinsight backend, check that it succeeded. For examples of sample runs, see [Run the MapReduce examples included in HDInsight](https://docs.microsoft.com/azure/hdinsight/hadoop/apache-hadoop-run-samples-linux)
686
-
1. If the job still failed on HDinsight, check the application logs and information, which to provide to Support:
685
+
1. If you run the same job on HDInsight backend, check that it succeeded. For examples of sample runs, see [Run the MapReduce examples included in HDInsight](https://docs.microsoft.com/azure/hdinsight/hadoop/apache-hadoop-run-samples-linux)
686
+
1. If the job still failed on HDInsight, check the application logs and information, which to provide to Support:
687
687
1. Check whether the job was submitted to YARN. If the job wasn't submitted to yarn, use `--master yarn`.
688
688
1. If the application finished execution, collect the start time and end time of the YARN Application. If the application didn't complete the execution, collect Start time/Launch time.
689
689
1. Check and collect application log with `yarn logs -applicationId <Insert_Your_Application_ID>`.
690
-
1. Check and collect the yarn resource manager logs under the `/var/log/hadoop-yarn/yarn` directory.
690
+
1. Check and collect the yarn Resource Manager logs under the `/var/log/hadoop-yarn/yarn` directory.
691
691
1. If these steps are not enough to resolve the issue, contact Azure HDInsight team for support and provide the above logs and timestamps.
692
692
693
693
### Error code: 2304
@@ -704,7 +704,7 @@ The following table applies to Azure Batch.
704
704
705
705
-**Cause**: The connection information for the HDI cluster is incorrect, the provided user doesn't have permissions to perform the required action, or the HDInsight service has issues responding to requests from ADF.
706
706
707
-
-**Recommendation**: Verify that the user information is correct, and that the Ambari UI for the HDI cluster can be opened in a browser from the VM where the IR is installed (in the case of a self-hosted IR), or can be opened from any machine (in the case of Azure IR).
707
+
-**Recommendation**: Verify that the user information is correct, and that the Ambari UI for the HDI cluster can be opened in a browser from the VM where the IR is installed (for a self-hosted IR), or can be opened from any machine (for Azure IR).
708
708
709
709
### Error code: 2306
710
710
@@ -868,7 +868,7 @@ The following table applies to Azure Batch.
868
868
869
869
-**Cause**: The storage linked service properties are not set correctly.
870
870
871
-
-**Recommendation**: Only full connection strings are supported in the main storage linked service for HDI activities. Verify that you are not using MSI auth or applications.
871
+
-**Recommendation**: Only full connection strings are supported in the main storage linked service for HDI activities. Verify that you are not using MSI authorizations or applications.
872
872
873
873
### Error code: 2350
874
874
@@ -916,7 +916,7 @@ The following table applies to Azure Batch.
916
916
917
917
-**Message**: `The '%value' provided for commandEnvironment is incorrect. The expected value should be an array of strings where each string has the format CmdEnvVarName=CmdEnvVarValue.`
918
918
919
-
-**Cause**: The provided for commandEnvironment is incorrect.
919
+
-**Cause**: The provided value for `commandEnvironment` is incorrect.
920
920
921
921
-**Recommendation**: Verify that the provided value is similar to:
922
922
@@ -931,7 +931,9 @@ The following table applies to Azure Batch.
931
931
932
932
- **Message**: `The commandEnvironment already contains a variable named '%variableName;'.`
933
933
934
-
- **Cause**: Verify that the provided value is similar to:
934
+
- **Cause**: The provided value for `commandEnvironment` is incorrect.
935
+
936
+
- **Recommendation**: Verify that the provided value is similar to:
935
937
936
938
``` \"commandEnvironment\": [
937
939
\"variableName=variableValue\"
@@ -986,15 +988,15 @@ The following table applies to Azure Batch.
986
988
987
989
- **Cause**: The provided additional storage was not Azure Blob storage.
988
990
989
-
- **Recommendation**: Provide an Azure Blob storage account as an additional storage for HDInsight ondemand linked service.
991
+
- **Recommendation**: Provide an Azure Blob storage account as an additional storage for HDInsight on-demand linked service.
990
992
991
993
## Web Activity
992
994
993
995
### Error code: 2128
994
996
995
997
- **Message**: `No response from the endpoint. Possible causes: network connectivity, DNS failure, server certificate validation or timeout.`
996
998
997
-
- **Cause**: This is a issue is due to either Network connectivity, a DNS failure, a server certificate validation, or a timeout.
999
+
- **Cause**: This issue is due to either Network connectivity, a DNS failure, a server certificate validation, or a timeout.
998
1000
999
1001
- **Recommendation**: Validate that the endpoint you are trying to hit is responding to requests. You may use tools like **Fiddler/Postman**.
0 commit comments