v1.42.0

New Features and Improvements

• Allow changes to display_name for databricks_service_principal (#3523).
• Modify databricks_repo to support Git folders in the workspace (#3447).
• Retry requests in the Databricks Go SDK until context timeout (#3537).
• Set ForceSendFields for boolean/integer values explicitly set to false/0 (#3385).

Bug fixes

• Added ConflictsWith to legacy tasks in databricks_job to avoid errors when job parameters are used (#3500).
• Fixed spn secret permanent diff (#3525).
• Introduced common.NoClientData helper function and use it in databricks_aws_crossaccount_policy data source to allow its use with workspace- or account-level providers (#3508).
• Set id attribute of databricks_metastore data source (#3503).

Documentation Changes

• Added documentation for compute options for tasks in databricks_job resource (#3504).
• Added warning about depends_on order (#3489).
• Fixed various doc typos (#3512).
• Fixed databricks_current_metastore data source names in docs examples (#3515).
• Improved Job documentation structure (#3511).
• Removed confusing mention of cloud types for databricks_clusters and databricks_sql_warehouses data sources (#3518).

Exporter

• Added UC support for DLT pipelines (#3494).
• Ignored instance pools with the empty name (#3522).

Internal Changes

• Added DATABRICKS_USER_AGENT_EXTRA (#3520).
• Adjusted list of supported platforms in godownloader-databricks-provider.sh (#3527).
• Switched to Go SDK for databricks_directory resource and data source (#3509).
• Fixed codecov for repository (#3530).

Dependency updates:

• Bump databricks-sdk-go to v0.40.0 (#3534).