Skip to content

Commit 80eca49

Browse files
committed
fix typos and add link for script action
1 parent e575757 commit 80eca49

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

articles/hdinsight/spark/apache-spark-python-package-installation.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ HDInsight Spark cluster is created with Anaconda installation. There are two Pyt
4646

4747
| |Python 2.7|Python 3.5|
4848
|----|----|----|
49-
|Path|/usr/bin/Anaconda/bin|/usr/bin/Anaconda/envs/py35/bin|
49+
|Path|/usr/bin/anaconda/bin|/usr/bin/anaconda/envs/py35/bin|
5050
|Spark|Default set to 2.7|N/A|
5151
|Livy|Default set to 2.7|N/A|
5252
|Jupyter|PySpark kernel|PySpark3 kernel|
@@ -88,7 +88,7 @@ HDInsight cluster depends on the built-in Python environment, both Python 2.7 an
8888
8989
```
9090
export PYSPARK_PYTHON=/usr/bin/anaconda/envs/py35new/bin/python
91-
xport PYSPARK_DRIVER_PYTHON=/usr/bin/anaconda/envs/py35new/bin/python
91+
export PYSPARK_DRIVER_PYTHON=/usr/bin/anaconda/envs/py35new/bin/python
9292
```
9393
9494
![Change Livy config through Ambari](./media/apache-spark-python-package-installation/ambari-livy-config.png)
@@ -117,7 +117,7 @@ HDInsight cluster depends on the built-in Python environment, both Python 2.7 an
117117
118118
## Known Issue
119119
120-
There is a known bug for Anaconda version 4.7.11 and 4.7.12. If you see your script actions hanging at `"Collecting package metadata (repodata.json): ...working..."` and failing with `"Python script has been killed due to timeout after waiting 3600 secs"`. You can download this script and run it as script actions on all nodes to fix the issue.
120+
There is a known bug for Anaconda version 4.7.11 and 4.7.12. If you see your script actions hanging at `"Collecting package metadata (repodata.json): ...working..."` and failing with `"Python script has been killed due to timeout after waiting 3600 secs"`. You can download [this script](https://gregorysfixes.blob.core.windows.net/public/fix-conda.sh) and run it as script actions on all nodes to fix the issue.
121121
122122
To check your Anaconda version, you can SSH to the cluster header node and run `/usr/bin/anaconda/bin/conda --v`.
123123

0 commit comments

Comments
 (0)