Skip to content

Commit 91e693d

Browse files
author
Calvin Wang
committed
Hotfix: deequ-1.2.2 breaking with spark 2.4 and 2.2, rolling back to deequ-1.1.0
1 parent 8032ab9 commit 91e693d

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

pydeequ/configs.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,10 @@
66
configs = {
77
"deequ_maven_coord": "com.amazon.deequ:deequ:1.2.2-spark-3.0",
88
"deequ_maven_coord_spark3": "com.amazon.deequ:deequ:1.2.2-spark-3.0",
9-
"deequ_maven_coord_spark2_4": "com.amazon.deequ:deequ:1.2.2-spark-2.4",
10-
"deequ_maven_coord_spark2_2": "com.amazon.deequ:deequ:1.2.2-spark-2.2",
9+
# "deequ_maven_coord_spark2_4": "com.amazon.deequ:deequ:1.2.2-spark-2.4", # 1.2.2 is broken, rolling back to 1.1.0 with scala 11
10+
"deequ_maven_coord_spark2_4": "com.amazon.deequ:deequ:1.1.0_spark-2.4-scala-2.11",
11+
# "deequ_maven_coord_spark2_2": "com.amazon.deequ:deequ:1.2.2-spark-2.2",
12+
"deequ_maven_coord_spark2_2": "com.amazon.deequ:deequ:1.1.0_spark-2.2-scala-2.11",
1113
"f2j_maven_coord": "net.sourceforge.f2j:arpack_combined_all",
1214
}
1315

0 commit comments

Comments
 (0)