@@ -4,6 +4,7 @@ description: Get answers to common questions about working with Apache Spark and
4
4
ms.service : hdinsight
5
5
author : hrasheed-msft
6
6
ms.author : hrasheed
7
+ ms.reviewer : jasonh
7
8
ms.topic : troubleshooting
8
9
ms.date : 08/22/2019
9
10
ms.custom : seodec18
@@ -21,49 +22,49 @@ Spark configuration values can be tuned help avoid an Apache Spark application `
21
22
22
23
1 . Navigate to ** Spark2** > ** Configs** .
23
24
24
- ![ Select the Configs tab] ( ./media/apache-troubleshoot-spark/update-config-2 .png )
25
+ ![ Select the Configs tab] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config2 .png )
25
26
26
27
1 . In the list of configurations, select and expand ** Custom-spark2-defaults** .
27
28
28
29
1 . Look for the value setting that you need to adjust, such as ** spark.executor.memory** . In this case, the value of ** 9728m** is too high.
29
30
30
- ![ Select custom-spark-defaults] ( ./media/apache-troubleshoot-spark/update-config-4 .png )
31
+ ![ Select custom-spark-defaults] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config4 .png )
31
32
32
33
1 . Set the value to the recommended setting. The value ** 2048m** is recommended for this setting.
33
34
34
35
1 . Save the value, and then save the configuration. Select ** Save** .
35
36
36
- ![ Change value to 2048m] ( ./media/apache-troubleshoot-spark/update-config-6a .png )
37
+ ![ Change value to 2048m] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config6a .png )
37
38
38
39
Write a note about the configuration changes, and then select ** Save** .
39
40
40
- ![ Enter a note about the changes you made] ( ./media/apache-troubleshoot-spark/update-config-6c .png )
41
+ ![ Enter a note about the changes you made] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config6c .png )
41
42
42
43
You are notified if any configurations need attention. Note the items, and then select ** Proceed Anyway** .
43
44
44
- ![ Select Proceed Anyway] ( ./media/apache-troubleshoot-spark/update-config-6b .png )
45
+ ![ Select Proceed Anyway] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config6b .png )
45
46
46
47
1 . Whenever a configuration is saved, you are prompted to restart the service. Select ** Restart** .
47
48
48
- ![ Select restart] ( ./media/apache-troubleshoot-spark/update-config-7a .png )
49
+ ![ Select restart] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config7a .png )
49
50
50
51
Confirm the restart.
51
52
52
- ![ Select Confirm Restart All] ( ./media/apache-troubleshoot-spark/update-config-7b .png )
53
+ ![ Select Confirm Restart All] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config7b .png )
53
54
54
55
You can review the processes that are running.
55
56
56
- ![ Review running processes] ( ./media/apache-troubleshoot-spark/update-config-7c .png )
57
+ ![ Review running processes] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config7c .png )
57
58
58
59
1 . You can add configurations. In the list of configurations, select ** Custom-spark2-defaults** , and then select ** Add Property** .
59
60
60
- ![ Select add property] ( ./media/apache-troubleshoot-spark/update-config-8 .png )
61
+ ![ Select add property] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config8 .png )
61
62
62
63
1 . Define a new property. You can define a single property by using a dialog box for specific settings such as the data type. Or, you can define multiple properties by using one definition per line.
63
64
64
65
In this example, the ** spark.driver.memory** property is defined with a value of ** 4g** .
65
66
66
- ![ Define new property] ( ./media/apache-troubleshoot-spark/update-config-9 .png )
67
+ ![ Define new property] ( ./media/apache-troubleshoot-spark/apache-spark-ambari-config9 .png )
67
68
68
69
1 . Save the configuration, and then restart the service as described in steps 6 and 7.
69
70
0 commit comments