Skip to content

Commit f0e4c95

Browse files
committed
[KYUUBI #7274] Bump Scala 2.13.17
### Why are the changes needed? Align Scala version with Spark 4.1. Exclude `SparkLocalClusterTest` due to Scala 2.13.17 changes `serialVersionUID` of `scala.collection.immutable.ArraySeq`. This should only be a test issue, I suppose we still preserve binary compatibility for the Spark engine jar - which means, the `kyuubi-spark-sql-engine_2.13-<version>.jar` compile against Spark 3.5, still works well for Spark 4.0, and the upcoming Spark 4.1 ### How was this patch tested? GHA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #7274 from pan3793/scala-2.13.17. Closes #7274 8cee0bd [Cheng Pan] disable SparkLocalClusterTest for spark 4.0 10a1a81 [Cheng Pan] Bump Scala 2.13.17 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org>
1 parent 18a5550 commit f0e4c95

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

pom.xml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1980,7 +1980,7 @@
19801980
<id>scala-2.13</id>
19811981
<properties>
19821982
<scala.binary.version>2.13</scala.binary.version>
1983-
<scala.version>2.13.16</scala.version>
1983+
<scala.version>2.13.17</scala.version>
19841984
<spark.archive.scala.suffix>-scala${scala.binary.version}</spark.archive.scala.suffix>
19851985
</properties>
19861986
</profile>
@@ -2053,7 +2053,8 @@
20532053
<!-- TODO: update once Paimon support Spark 4.0.
20542054
paimon-spark-3.5 contains Scala 2.12 classes cause conflicts with Scala 2.13 -->
20552055
<paimon.artifact>paimon-common</paimon.artifact>
2056-
<maven.plugin.scalatest.exclude.tags>org.scalatest.tags.Slow,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.HudiTest</maven.plugin.scalatest.exclude.tags>
2056+
<!-- Exclude SparkLocalClusterTest due to Scala 2.13.17 changes serialVersionUID of scala.collection.immutable.ArraySeq -->
2057+
<maven.plugin.scalatest.exclude.tags>org.scalatest.tags.Slow,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.HudiTest,org.apache.kyuubi.tags.SparkLocalClusterTest</maven.plugin.scalatest.exclude.tags>
20572058
<spark.archive.name>spark-${spark.version}-bin-hadoop3.tgz</spark.archive.name>
20582059
</properties>
20592060
</profile>

0 commit comments

Comments
 (0)