Skip to content

Commit 451f408

Browse files
committed
Upgrade graphframes script to 0.8.1 using Spark 3 as target
1 parent 0c4880a commit 451f408

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

spark/graphframes.sh

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,7 @@
11
#!/bin/bash
22
set -euo pipefail
33

4-
# 0.5.0 seems to be broken at this point,
5-
# check this issue https://git.io/vNjRt
6-
readonly PKG="graphframes:graphframes:0.4.0-spark2.1-s_2.11"
4+
readonly PKG="graphframes:graphframes:0.8.1-spark3.0-s_2.12"
75
if [ $# -eq 0 ]; then
86
pyspark --packages $PKG
97
else

0 commit comments

Comments
 (0)