Skip to content

Commit fa73bde

Browse files
committed
Merge branch 'master' of https://github.com/MicrosoftDocs/azure-docs-pr into recurrence
2 parents a276f4b + a6bcff3 commit fa73bde

7 files changed

+126
-81
lines changed

articles/hdinsight/TOC.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,8 @@
229229
href: ./troubleshoot-script-action.md
230230
- name: Resource creation failures
231231
href: ./troubleshoot-resource-creation-fails.md
232+
- name: Troubleshoot Apache Oozie
233+
href: ./troubleshoot-oozie.md
232234
- name: Reference
233235
items:
234236
- name: Azure PowerShell

articles/hdinsight/hdinsight-use-oozie-linux-mac.md

Lines changed: 2 additions & 62 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.reviewer: jasonh
77
ms.service: hdinsight
88
ms.topic: conceptual
99
ms.custom: seoapr2020
10-
ms.date: 04/23/2020
10+
ms.date: 04/27/2020
1111
---
1212

1313
# Use Apache Oozie with Apache Hadoop to define and run a workflow on Linux-based Azure HDInsight
@@ -639,71 +639,11 @@ You can use the coordinator to specify a start, an end, and the occurrence frequ
639639
640640
![OOzie web console job info tab](./media/hdinsight-use-oozie-linux-mac/coordinator-action-job.png)
641641
642-
## Troubleshooting
643-
644-
With the Oozie UI, you can view Oozie logs. The Oozie UI also contains links to the JobTracker logs for the MapReduce tasks that were started by the workflow. The pattern for troubleshooting should be:
645-
646-
1. View the job in Oozie web UI.
647-
648-
2. If there's an error or failure for a specific action, select the action to see if the **Error Message** field provides more information on the failure.
649-
650-
3. If available, use the URL from the action to view more details, such as the JobTracker logs, for the action.
651-
652-
The following are specific errors you might come across and how to resolve them.
653-
654-
### JA009: Can't initialize cluster
655-
656-
**Symptoms**: The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. Selecting the action displays the following error message:
657-
658-
JA009: Cannot initialize Cluster. Please check your configuration for map
659-
660-
**Cause**: The Azure Blob storage addresses used in the **job.xml** file doesn't contain the storage container or storage account name. The Blob storage address format must be `wasbs://[email protected]`.
661-
662-
**Resolution**: Change the Blob storage addresses that the job uses.
663-
664-
### JA002: Oozie isn't allowed to impersonate <USER>
665-
666-
**Symptoms**: The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. If you select the action, it shows the following error message:
667-
668-
JA002: User: oozie is not allowed to impersonate <USER>
669-
670-
**Cause**: The current permission settings don't allow Oozie to impersonate the specified user account.
671-
672-
**Resolution**: Oozie can impersonate users in the **`users`** group. Use the `groups USERNAME` to see the groups that the user account is a member of. If the user isn't a member of the **`users`** group, use the following command to add the user to the group:
673-
674-
sudo adduser USERNAME users
675-
676-
> [!NOTE]
677-
> It can take several minutes before HDInsight recognizes that the user has been added to the group.
678-
679-
### Launcher ERROR (Sqoop)
680-
681-
**Symptoms**: The job status changes to **KILLED**. Details for the job show the `RunSqoopExport` status as **ERROR**. If you select the action, it shows the following error message:
682-
683-
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
684-
685-
**Cause**: Sqoop is unable to load the database driver required to access the database.
686-
687-
**Resolution**: When you use Sqoop from an Oozie job, you must include the database driver with the other resources, such as the workflow.xml, the job uses. Also, reference the archive that contains the database driver from the `<sqoop>...</sqoop>` section of the workflow.xml.
688-
689-
For example, for the job in this document, you would use the following steps:
690-
691-
1. Copy the `mssql-jdbc-7.0.0.jre8.jar` file to the **/tutorials/useoozie** directory:
692-
693-
```bash
694-
hdfs dfs -put /usr/share/java/sqljdbc_7.0/enu/mssql-jdbc-7.0.0.jre8.jar /tutorials/useoozie/mssql-jdbc-7.0.0.jre8.jar
695-
```
696-
697-
2. Modify the `workflow.xml` to add the following XML on a new line above `</sqoop>`:
698-
699-
```xml
700-
<archive>mssql-jdbc-7.0.0.jre8.jar</archive>
701-
```
702-
703642
## Next steps
704643
705644
In this article, you learned how to define an Oozie workflow and how to run an Oozie job. To learn more about how to work with HDInsight, see the following articles:
706645
707646
* [Upload data for Apache Hadoop jobs in HDInsight](hdinsight-upload-data.md)
708647
* [Use Apache Sqoop with Apache Hadoop in HDInsight](hadoop/apache-hadoop-use-sqoop-mac-linux.md)
709648
* [Use Apache Hive with Apache Hadoop on HDInsight](hadoop/hdinsight-use-hive.md)
649+
* [Troubleshoot Apache Oozie](./troubleshoot-oozie.md)
Lines changed: 103 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,103 @@
1+
---
2+
title: Troubleshoot Apache Oozie in Azure HDInsight
3+
description: Troubleshoot certain Apache Oozie errors in Azure HDInsight.
4+
author: hrasheed-msft
5+
ms.author: hrasheed
6+
ms.reviewer: jasonh
7+
ms.service: hdinsight
8+
ms.topic: troubleshooting
9+
ms.date: 04/27/2020
10+
---
11+
12+
# Troubleshoot Apache Oozie in Azure HDInsight
13+
14+
With the Apache Oozie UI, you can view Oozie logs. The Oozie UI also contains links to the JobTracker logs for the MapReduce tasks that were started by the workflow. The pattern for troubleshooting should be:
15+
16+
1. View the job in Oozie web UI.
17+
18+
2. If there's an error or failure for a specific action, select the action to see if the **Error Message** field provides more information on the failure.
19+
20+
3. If available, use the URL from the action to view more details, such as the JobTracker logs, for the action.
21+
22+
The following are specific errors you might come across and how to resolve them.
23+
24+
## JA009: Can't initialize cluster
25+
26+
### Issue
27+
28+
The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. Selecting the action displays the following error message:
29+
30+
JA009: Cannot initialize Cluster. Please check your configuration for map
31+
32+
### Cause
33+
34+
The Azure Blob storage addresses used in the **job.xml** file doesn't contain the storage container or storage account name. The Blob storage address format must be `wasbs://[email protected]`.
35+
36+
### Resolution
37+
38+
Change the Blob storage addresses that the job uses.
39+
40+
---
41+
42+
## JA002: Oozie isn't allowed to impersonate &lt;USER&gt;
43+
44+
### Issue
45+
46+
The job status changes to **SUSPENDED**. Details for the job show the `RunHiveScript` status as **START_MANUAL**. If you select the action, it shows the following error message:
47+
48+
JA002: User: oozie is not allowed to impersonate <USER>
49+
50+
### Cause
51+
52+
The current permission settings don't allow Oozie to impersonate the specified user account.
53+
54+
### Resolution
55+
56+
Oozie can impersonate users in the **`users`** group. Use the `groups USERNAME` to see the groups that the user account is a member of. If the user isn't a member of the **`users`** group, use the following command to add the user to the group:
57+
58+
sudo adduser USERNAME users
59+
60+
> [!NOTE]
61+
> It can take several minutes before HDInsight recognizes that the user has been added to the group.
62+
63+
---
64+
65+
## Launcher ERROR (Sqoop)
66+
67+
### Issue
68+
69+
The job status changes to **KILLED**. Details for the job show the `RunSqoopExport` status as **ERROR**. If you select the action, it shows the following error message:
70+
71+
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
72+
73+
### Cause
74+
75+
Sqoop is unable to load the database driver required to access the database.
76+
77+
### Resolution
78+
79+
When you use Sqoop from an Oozie job, you must include the database driver with the other resources, such as the workflow.xml, the job uses. Also, reference the archive that contains the database driver from the `<sqoop>...</sqoop>` section of the workflow.xml.
80+
81+
For example, for the job example from [Use Hadoop Oozie workflows](hdinsight-use-oozie-linux-mac.md), you would use the following steps:
82+
83+
1. Copy the `mssql-jdbc-7.0.0.jre8.jar` file to the **/tutorials/useoozie** directory:
84+
85+
```bash
86+
hdfs dfs -put /usr/share/java/sqljdbc_7.0/enu/mssql-jdbc-7.0.0.jre8.jar /tutorials/useoozie/mssql-jdbc-7.0.0.jre8.jar
87+
```
88+
89+
2. Modify the `workflow.xml` to add the following XML on a new line above `</sqoop>`:
90+
91+
```xml
92+
<archive>mssql-jdbc-7.0.0.jre8.jar</archive>
93+
```
94+
95+
## Next steps
96+
97+
If you didn't see your problem or are unable to solve your issue, visit one of the following channels for more support:
98+
99+
* Get answers from Azure experts through [Azure Community Support](https://azure.microsoft.com/support/community/).
100+
101+
* Connect with [@AzureSupport](https://twitter.com/azuresupport) - the official Microsoft Azure account for improving customer experience. Connecting the Azure community to the right resources: answers, support, and experts.
102+
103+
* If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).

0 commit comments

Comments
 (0)