Skip to content

Commit 8f81bde

Browse files
velvianoorul
authored andcommitted
misc(build): disable assembly in job-server module (spark-jobserver#959)
* misc(build): disable assembly in job-server module Assembly in job-server module without extras doesn't make much sense; that will not allow most jobs to run * misc(doc): Clarify assembly building in deploy steps of README
1 parent 6be0a20 commit 8f81bde

File tree

2 files changed

+2
-3
lines changed

2 files changed

+2
-3
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -582,7 +582,7 @@ See also running on [cluster](doc/cluster.md), [YARN client](doc/yarn.md), on [E
582582
583583
The `server_start.sh` script uses `spark-submit` under the hood and may be passed any of the standard extra arguments from `spark-submit`.
584584
585-
NOTE: by default the assembly jar from `job-server-extras`, which includes support for SQLContext and HiveContext, is used. If you face issues with all the extra dependencies, consider modifying the install scripts to invoke `sbt job-server/assembly` instead, which doesn't include the extra dependencies.
585+
NOTE: Under the hood, the deploy scripts generate an assembly jar from the `job-server-extras` project. Generating assemblies from other projects may not include all the necessary components for job execution.
586586
587587
### Context per JVM
588588

build.sbt

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ lazy val akkaApp = Project(id = "akka-app", base = file("akka-app"))
1515
lazy val jobServer = Project(id = "job-server", base = file("job-server"))
1616
.settings(commonSettings)
1717
.settings(revolverSettings)
18-
.settings(Assembly.settings)
18+
.settings(assembly := null.asInstanceOf[File])
1919
.settings(
2020
description := "Spark as a Service: a RESTful job server for Apache Spark",
2121
libraryDependencies ++= sparkDeps ++ slickDeps ++ cassandraDeps ++ securityDeps ++ coreTestDeps,
@@ -31,7 +31,6 @@ lazy val jobServer = Project(id = "job-server", base = file("job-server"))
3131
fullClasspath in Compile <<= (fullClasspath in Compile).map { classpath =>
3232
extraJarPaths ++ classpath
3333
},
34-
test in assembly := {},
3534
fork in Test := true
3635
)
3736
.settings(publishSettings)

0 commit comments

Comments
 (0)