Skip to content

Commit 708c3e9

Browse files
author
maxim-lixakov
committed
[DOP-21445] add optional enableHiveSupport
1 parent 4d4952c commit 708c3e9

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

tests/test_integration/test_run_transfer/conftest.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -66,11 +66,13 @@ def spark(settings: Settings, request: FixtureRequest) -> SparkSession:
6666

6767
spark = (
6868
SparkSession.builder.appName("celery_worker")
69-
.enableHiveSupport()
7069
.config("spark.sql.pyspark.jvmStacktrace.enabled", "true")
7170
.config("spark.driver.host", "localhost")
7271
)
7372

73+
if "hive" in markers:
74+
spark = spark.enableHiveSupport()
75+
7476
if "postgres" in markers:
7577
maven_packages.extend(Postgres.get_packages())
7678

0 commit comments

Comments
 (0)