Skip to content

Commit bb17665

Browse files
dongjoon-hyunLuciferYang
authored andcommitted
[SPARK-49249][SQL][FOLLOWUP] Rename spark.sql.artifact.isolation.(always.apply.classloader -> alwaysApplyClassloader)
### What changes were proposed in this pull request? This is a follow-up to rename a new configuration to comply Apache Spark config namespace. - #48120 ### Why are the changes needed? Currently, `spark.sql.artifact.isolation.always.apply.classloader` config name introduces redundant namespace `spark.sql.artifact.isolation.always.*` and `spark.sql.artifact.isolation.always.apply.*`. ``` - spark.sql.artifact.isolation.always.apply.classloader + spark.sql.artifact.isolation.alwaysApplyClassloader ``` Since we have `spark.sql.artifact.isolation.enabled` already, we had better keep the above in the same namespace `spark.sql.artifact.isolation.*`. ### Does this PR introduce _any_ user-facing change? No, this is a newly added configuration at Spark 4.0.0 ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #49101 from dongjoon-hyun/SPARK-49249. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: yangjie01 <[email protected]>
1 parent fff6793 commit bb17665

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

python/pyspark/sql/connect/session.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1044,7 +1044,7 @@ def _start_connect_server(master: str, opts: Dict[str, Any]) -> None:
10441044
default_conf = {
10451045
"spark.plugins": "org.apache.spark.sql.connect.SparkConnectPlugin",
10461046
"spark.sql.artifact.isolation.enabled": "true",
1047-
"spark.sql.artifact.isolation.always.apply.classloader": "true",
1047+
"spark.sql.artifact.isolation.alwaysApplyClassloader": "true",
10481048
}
10491049

10501050
if "SPARK_TESTING" in os.environ:

sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3999,7 +3999,7 @@ object SQLConf {
39993999
.createWithDefault(true)
40004000

40014001
val ARTIFACTS_SESSION_ISOLATION_ALWAYS_APPLY_CLASSLOADER =
4002-
buildConf("spark.sql.artifact.isolation.always.apply.classloader")
4002+
buildConf("spark.sql.artifact.isolation.alwaysApplyClassloader")
40034003
.internal()
40044004
.doc("When enabled, the classloader holding per-session artifacts will always be applied " +
40054005
"during SQL executions (useful for Spark Connect). When disabled, the classloader will " +

0 commit comments

Comments
 (0)