Skip to content

Commit df42565

Browse files
committed
Update Scala and Spark versions.
1 parent dddffe2 commit df42565

File tree

4 files changed

+6
-5
lines changed

4 files changed

+6
-5
lines changed

.github/workflows/test.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,11 +27,11 @@ jobs:
2727
strategy:
2828
fail-fast: false
2929
matrix:
30-
scala: [2.11.12, 2.12.12]
31-
spark: [2.4.7, 3.0.1]
30+
scala: [2.11.12, 2.12.14]
31+
spark: [2.4.8, 3.1.2]
3232
exclude:
3333
- scala: 2.11.12
34-
spark: 3.0.1
34+
spark: 3.1.2
3535
name: Test Spark ${{matrix.spark}} on Scala ${{matrix.scala}}
3636
steps:
3737
- name: Checkout code

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ Please, use the table below to determine what version of spark-hats to use for S
3232
|:------------------:|:-------------:|:---------------:|
3333
| 0.1.x | 2.11, 2.12 | 2.4.3+ |
3434
| 0.2.x | 2.11, 2.12 | 2.4.3+ |
35+
| 0.2.x | 2.12 | 3.0.0+ |
3536

3637
To use the extensions you need to add this import to your Spark application or shell:
3738
```scala

build.sbt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@
1717
import Dependencies._
1818

1919
val scala211 = "2.11.12"
20-
val scala212 = "2.12.10"
20+
val scala212 = "2.12.14"
2121

2222
ThisBuild / organization := "za.co.absa"
2323

project/Dependencies.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ import sbt._
1818

1919
object Dependencies {
2020

21-
def sparkVersion: String = sys.props.getOrElse("SPARK_VERSION", "2.4.7")
21+
def sparkVersion: String = sys.props.getOrElse("SPARK_VERSION", "2.4.8")
2222
private val sparkHofsVersion = "0.4.0"
2323

2424
private val scalatestVersion = "3.0.3"

0 commit comments

Comments
 (0)