Skip to content

Commit 6afeffc

Browse files
Merge pull request #10 from fjakobs/patch-2
Don't use global spark
2 parents ae08f59 + ff86746 commit 6afeffc

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

jobs/covid_trends_job.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,8 +8,7 @@
88

99
from covid_analysis.transforms import *
1010

11-
# tell Python the type of the spark global so code completion works
12-
spark: SparkSession = spark
11+
spark = SparkSession.builder.getOrCreate()
1312

1413
# check if job is running in production mode
1514
is_prod = len(sys.argv) >= 2 and sys.argv[1] == "--prod"

0 commit comments

Comments
 (0)