-
Notifications
You must be signed in to change notification settings - Fork 175
Open
Description
Description
spark.conf.get raises instead of returning None or a default value according to the documentation.
Reproduction
from databricks.sdk.runtime import spark
spark.conf.get("xxxxx") # -> Error instead of `None`
spark.conf.get("xxxxx", "my_default") # -> Error instead of "my_default"Expected behavior
According to the docs it should NOT raise but either return None or the provided default value.
Happens locally with databricks sdk but also in the databricks workspace in a notebook.
Debug Logs
AnalysisException: [CONFIG_NOT_AVAILABLE] Configuration xxxxx is not available. SQLSTATE: 42K0I
Metadata
Metadata
Assignees
Labels
No labels