Skip to content

Commit 90186f7

Browse files
authored
Merge pull request #347 from ldbc/remove-spark2.4
2 parents 267c758 + cf86e85 commit 90186f7

File tree

2 files changed

+0
-39
lines changed

2 files changed

+0
-39
lines changed

README.md

Lines changed: 0 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -81,35 +81,6 @@ export DATAGEN_VERSION=0.5.0-SNAPSHOT
8181
tools/run.py ./target/ldbc_snb_datagen_${PLATFORM_VERSION}-${DATAGEN_VERSION}.jar <runtime configuration arguments> -- <generator configuration arguments>
8282
```
8383

84-
#### Older Spark versions
85-
86-
##### Spark 2.4.x
87-
88-
Spark 2.4.x with Hadoop 2.7 (Scala 2.11 / JVM 8) is supported, but it is recommended to switch to Spark 3.
89-
90-
```bash
91-
curl https://archive.apache.org/dist/spark/spark-2.4.8/spark-2.4.8-bin-hadoop2.7.tgz | sudo tar -xz -C /opt/
92-
export SPARK_HOME="/opt/spark-2.4.8-bin-hadoop2.7"
93-
export PATH="$SPARK_HOME/bin":"$PATH"
94-
```
95-
96-
Make sure you use Java 8.
97-
98-
To build, run
99-
100-
```bash
101-
tools/build.sh -Pspark2.4
102-
```
103-
104-
Run the script with:
105-
106-
```bash
107-
export PLATFORM_VERSION=2.11_spark2.4
108-
export DATAGEN_VERSION=0.5.0-SNAPSHOT
109-
110-
tools/run.py ./target/ldbc_snb_datagen_${PLATFORM_VERSION}-${DATAGEN_VERSION}.jar <runtime configuration arguments> -- <generator configuration arguments>
111-
```
112-
11384
#### Runtime configuration arguments
11485

11586
The runtime configuration arguments determine the amount of memory, number of threads, degree of parallelism. For a list of arguments, see:

pom.xml

Lines changed: 0 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -299,15 +299,5 @@
299299
<!-- This is the default profile. -->
300300
</properties>
301301
</profile>
302-
<profile>
303-
<id>spark2.4</id>
304-
<properties>
305-
<java.version>1.8</java.version>
306-
<scala.version>2.11.12</scala.version>
307-
<scala.compat.version>2.11</scala.compat.version>
308-
<spark.version>2.4.8</spark.version>
309-
<spark.compat.version>2.4</spark.compat.version>
310-
</properties>
311-
</profile>
312302
</profiles>
313303
</project>

0 commit comments

Comments
 (0)