Skip to content

Commit 8ec237a

Browse files
authored
fix: build spark step load right deploy type (#1254)
Fix #1253
1 parent ff235e8 commit 8ec237a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

awswrangler/emr.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1022,7 +1022,7 @@ def build_spark_step(
10221022
else:
10231023
config: str = "hdfs:///user/hadoop/config.json"
10241024
cmd = (
1025-
f"spark-submit --deploy-mode cluster "
1025+
f"spark-submit --deploy-mode {deploy_mode} "
10261026
f"--conf spark.executorEnv.YARN_CONTAINER_RUNTIME_TYPE=docker "
10271027
f"--conf spark.executorEnv.YARN_CONTAINER_RUNTIME_DOCKER_IMAGE={docker_image} "
10281028
f"--conf spark.executorEnv.YARN_CONTAINER_RUNTIME_DOCKER_CLIENT_CONFIG={config} "

0 commit comments

Comments
 (0)