Skip to content

Commit bb68631

Browse files
authored
Switch lightweight-spark-distrib to the VL fork & bump to 0.0.5 (#2503)
1 parent eced0b3 commit bb68631

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

DEV.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -163,7 +163,7 @@ Here's some of the more important external projects used by Scala CLI:
163163
stripped up of its benchmark infrastructure and build integrations.
164164
- [no-crc32-zip-input-stream](https://github.com/scala-cli/no-crc32-zip-input-stream): A copy of `ZipInputStream`
165165
from OpenJDK, with CRC32 calculations disabled.
166-
- [lightweight-spark-distrib](https://github.com/scala-cli/lightweight-spark-distrib): a small application allowing
166+
- [lightweight-spark-distrib](https://github.com/VirtusLab/lightweight-spark-distrib): a small application allowing
167167
to make Spark distributions more lightweight.
168168
- [java-class-name](https://github.com/scala-cli/java-class-name): a small library to extract class names
169169
from Java sources.

modules/integration/src/test/scala/scala/cli/integration/SparkTestDefinitions.scala

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,15 +9,15 @@ import scala.util.Properties
99

1010
object SparkTestDefinitions {
1111

12-
def lightweightSparkDistribVersionOpt = Option("0.0.4")
12+
def lightweightSparkDistribVersionOpt: Option[String] = Option("0.0.5")
1313

1414
final class Spark(val sparkVersion: String, val scalaVersion: String) {
1515
private def sbv = scalaVersion.split('.').take(2).mkString(".")
1616
private var toDeleteOpt = Option.empty[os.Path]
1717
lazy val sparkHome: os.Path = {
1818
val url = lightweightSparkDistribVersionOpt match {
1919
case Some(lightweightSparkDistribVersion) =>
20-
s"https://github.com/scala-cli/lightweight-spark-distrib/releases/download/v$lightweightSparkDistribVersion/spark-$sparkVersion-bin-hadoop2.7-scala$sbv.tgz"
20+
s"https://github.com/VirtusLab/lightweight-spark-distrib/releases/download/v$lightweightSparkDistribVersion/spark-$sparkVersion-bin-hadoop2.7-scala$sbv.tgz"
2121
case None =>
2222
// original URL (too heavyweight, often fails / times out…)
2323
s"https://archive.apache.org/dist/spark/spark-$sparkVersion/spark-$sparkVersion-bin-hadoop2.7.tgz"

0 commit comments

Comments
 (0)