You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-use-oozie-linux-mac.md
+2-62Lines changed: 2 additions & 62 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ ms.reviewer: jasonh
7
7
ms.service: hdinsight
8
8
ms.topic: conceptual
9
9
ms.custom: seoapr2020
10
-
ms.date: 04/23/2020
10
+
ms.date: 04/27/2020
11
11
---
12
12
13
13
# Use Apache Oozie with Apache Hadoop to define and run a workflow on Linux-based Azure HDInsight
@@ -639,71 +639,11 @@ You can use the coordinator to specify a start, an end, and the occurrence frequ
639
639
640
640

641
641
642
-
## Troubleshooting
643
-
644
-
With the Oozie UI, you can view Oozie logs. The Oozie UI also contains links to the JobTracker logs for the MapReduce tasks that were started by the workflow. The pattern for troubleshooting should be:
645
-
646
-
1. View the job in Oozie web UI.
647
-
648
-
2. If there's an error or failure for a specific action, selectthe action to see if the **Error Message** field provides more information on the failure.
649
-
650
-
3. If available, use the URL from the action to view more details, such as the JobTracker logs, for the action.
651
-
652
-
The following are specific errors you might come across and how to resolve them.
653
-
654
-
### JA009: Can't initialize cluster
655
-
656
-
**Symptoms**: The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. Selecting the action displays the following error message:
657
-
658
-
JA009: Cannot initialize Cluster. Please check your configuration for map
659
-
660
-
**Cause**: The Azure Blob storage addresses used in the **job.xml** file doesn't contain the storage container or storage account name. The Blob storage address format must be `wasbs://[email protected]`.
661
-
662
-
**Resolution**: Change the Blob storage addresses that the job uses.
663
-
664
-
### JA002: Oozie isn't allowed to impersonate <USER>
665
-
666
-
**Symptoms**: The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. If you selectthe action, it shows the following error message:
667
-
668
-
JA002: User: oozie is not allowed to impersonate <USER>
669
-
670
-
**Cause**: The current permission settings don't allow Oozie to impersonate the specified user account.
671
-
672
-
**Resolution**: Oozie can impersonate users in the **`users`** group. Use the `groups USERNAME` to see the groups that the user account is a member of. If the user isn't a member of the **`users`** group, use the following command to add the user to the group:
673
-
674
-
sudo adduser USERNAME users
675
-
676
-
> [!NOTE]
677
-
> It can take several minutes before HDInsight recognizes that the user has been added to the group.
678
-
679
-
### Launcher ERROR (Sqoop)
680
-
681
-
**Symptoms**: The job status changes to **KILLED**. Details for the job show the `RunSqoopExport` status as **ERROR**. If you selectthe action, it shows the following error message:
682
-
683
-
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
684
-
685
-
**Cause**: Sqoop is unable to load the database driver required to access the database.
686
-
687
-
**Resolution**: When you use Sqoop from an Oozie job, you must include the database driver with the other resources, such as the workflow.xml, the job uses. Also, reference the archive that contains the database driver from the `<sqoop>...</sqoop>` section of the workflow.xml.
688
-
689
-
For example, forthe jobin this document, you would use the following steps:
690
-
691
-
1. Copy the `mssql-jdbc-7.0.0.jre8.jar` file to the **/tutorials/useoozie** directory:
2. Modify the `workflow.xml` to add the following XML on a new line above `</sqoop>`:
698
-
699
-
```xml
700
-
<archive>mssql-jdbc-7.0.0.jre8.jar</archive>
701
-
```
702
-
703
642
## Next steps
704
643
705
644
In this article, you learned how to define an Oozie workflow and how to run an Oozie job. To learn more about how to work with HDInsight, see the following articles:
706
645
707
646
* [Upload data for Apache Hadoop jobs in HDInsight](hdinsight-upload-data.md)
708
647
* [Use Apache Sqoop with Apache Hadoop in HDInsight](hadoop/apache-hadoop-use-sqoop-mac-linux.md)
709
648
* [Use Apache Hive with Apache Hadoop on HDInsight](hadoop/hdinsight-use-hive.md)
title: Troubleshoot Apache Oozie in Azure HDInsight
3
+
description: Troubleshoot certain Apache Oozie errors in Azure HDInsight.
4
+
author: hrasheed-msft
5
+
ms.author: hrasheed
6
+
ms.reviewer: jasonh
7
+
ms.service: hdinsight
8
+
ms.topic: troubleshooting
9
+
ms.date: 04/27/2020
10
+
---
11
+
12
+
# Troubleshoot Apache Oozie in Azure HDInsight
13
+
14
+
With the Apache Oozie UI, you can view Oozie logs. The Oozie UI also contains links to the JobTracker logs for the MapReduce tasks that were started by the workflow. The pattern for troubleshooting should be:
15
+
16
+
1. View the job in Oozie web UI.
17
+
18
+
2. If there's an error or failure for a specific action, select the action to see if the **Error Message** field provides more information on the failure.
19
+
20
+
3. If available, use the URL from the action to view more details, such as the JobTracker logs, for the action.
21
+
22
+
The following are specific errors you might come across and how to resolve them.
23
+
24
+
## JA009: Can't initialize cluster
25
+
26
+
### Issue
27
+
28
+
The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. Selecting the action displays the following error message:
29
+
30
+
JA009: Cannot initialize Cluster. Please check your configuration for map
31
+
32
+
### Cause
33
+
34
+
The Azure Blob storage addresses used in the **job.xml** file doesn't contain the storage container or storage account name. The Blob storage address format must be `wasbs://[email protected]`.
35
+
36
+
### Resolution
37
+
38
+
Change the Blob storage addresses that the job uses.
39
+
40
+
---
41
+
42
+
## JA002: Oozie isn't allowed to impersonate <USER>
43
+
44
+
### Issue
45
+
46
+
The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. If you select the action, it shows the following error message:
47
+
48
+
JA002: User: oozie is not allowed to impersonate <USER>
49
+
50
+
### Cause
51
+
52
+
The current permission settings don't allow Oozie to impersonate the specified user account.
53
+
54
+
### Resolution
55
+
56
+
Oozie can impersonate users in the **`users`** group. Use the `groups USERNAME` to see the groups that the user account is a member of. If the user isn't a member of the **`users`** group, use the following command to add the user to the group:
57
+
58
+
sudo adduser USERNAME users
59
+
60
+
> [!NOTE]
61
+
> It can take several minutes before HDInsight recognizes that the user has been added to the group.
62
+
63
+
---
64
+
65
+
## Launcher ERROR (Sqoop)
66
+
67
+
### Issue
68
+
69
+
The job status changes to **KILLED**. Details for the job show the `RunSqoopExport` status as **ERROR**. If you select the action, it shows the following error message:
70
+
71
+
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
72
+
73
+
### Cause
74
+
75
+
Sqoop is unable to load the database driver required to access the database.
76
+
77
+
### Resolution
78
+
79
+
When you use Sqoop from an Oozie job, you must include the database driver with the other resources, such as the workflow.xml, the job uses. Also, reference the archive that contains the database driver from the `<sqoop>...</sqoop>` section of the workflow.xml.
80
+
81
+
For example, for the job example from [Use Hadoop Oozie workflows](hdinsight-use-oozie-linux-mac.md), you would use the following steps:
82
+
83
+
1. Copy the `mssql-jdbc-7.0.0.jre8.jar` file to the **/tutorials/useoozie** directory:
2. Modify the `workflow.xml` to add the following XML on a new line above `</sqoop>`:
90
+
91
+
```xml
92
+
<archive>mssql-jdbc-7.0.0.jre8.jar</archive>
93
+
```
94
+
95
+
## Next steps
96
+
97
+
If you didn't see your problem or are unable to solve your issue, visit one of the following channels for more support:
98
+
99
+
* Get answers from Azure experts through [Azure Community Support](https://azure.microsoft.com/support/community/).
100
+
101
+
* Connect with [@AzureSupport](https://twitter.com/azuresupport) - the official Microsoft Azure account for improving customer experience. Connecting the Azure community to the right resources: answers, support, and experts.
102
+
103
+
* If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).
0 commit comments