File tree Expand file tree Collapse file tree 2 files changed +4
-2
lines changed Expand file tree Collapse file tree 2 files changed +4
-2
lines changed Original file line number Diff line number Diff line change @@ -16,7 +16,8 @@ obtaining the connector and deploying an example application to MarkLogic.
1616The [ PySpark installation guide] ( https://spark.apache.org/docs/latest/api/python/getting_started/install.html ) describes
1717how to install PySpark. As noted in that guide, you will need to install Python 3 first if you do not already have it
1818installed. [ pyenv] ( https://github.com/pyenv/pyenv#installation ) is a popular choice for doing so, as it simplifies
19- installing and switching between multiple versions of Python.
19+ installing and switching between multiple versions of Python. Additionally, be sure to select a PySpark installation
20+ that depends on Scala 2.12 and not Scala 2.13.
2021
2122Once you have installed PySpark, run the following from a command line to ensure PySpark is installed correctly:
2223
Original file line number Diff line number Diff line change @@ -12,7 +12,8 @@ from any data source that Spark supports and then writing it to MarkLogic.
1212
1313The connector has the following system requirements:
1414
15- * Apache Spark 3.3.0 or higher. The connector has been tested with the latest versions of Spark 3.3.x of 3.4.x.
15+ * Apache Spark 3.5.3 is recommended, but earlier versions of Spark 3.4.x and 3.3.x should work as well. When choosing
16+ [ a Spark distribution] ( https://spark.apache.org/downloads.html ) , you must select a distribution that uses Scala 2.12 and not Scala 2.13.
1617* For writing data, MarkLogic 9.0-9 or higher.
1718* For reading data, MarkLogic 10.0-9 or higher.
1819
You can’t perform that action at this time.
0 commit comments