Skip to content

Releases: databricks/terraform-provider-databricks

v0.4.5

13 Jan 17:39
01584b1

Choose a tag to compare

  • Cross-linked resource documentation (#1027).
  • Added Azure example for sql_global_config (#1028).

Updated dependency versions:

  • Bump google.golang.org/api from 0.63.0 to 0.65.0

v0.4.4

05 Jan 16:18
f3a65bc

Choose a tag to compare

  • Added support for running provider in a debug mode from Visual Studio Code through Debug Provider run configuration in order to troubleshoot more complicated issues.
  • Allowed managing of libraries on databricks_cluster outside of Terraform state for resources without any library configuration blocks. This should simplify PaaS-like CI/CD workflows (#1024).
  • Added experimental resources.

Behavior changes

v0.4.3

30 Dec 18:43
2c39ae8

Choose a tag to compare

  • Added support for databricks_permissions for databricks_mlflow_experiment and databricks_mlflow_model (#1013).
  • Added Using XXX auth explanation to HTTP 403 errors, which should help troubleshooting misconfigured authentication or provider aliasing. Example error message now looks like: cannot create group: /2.0/preview/scim/v2/Groups is only accessible by admins. Using databricks-cli auth: host=https://XXX.cloud.databricks.com/, token=***REDACTED***, profile=demo. All sensitive configuration parameters (token, password, and azure_client_secret) are redacted and replaced with ***REDACTED*** (#821).
  • Improved documentation with regards to public subnets in AWS quick start (#1005).
  • Added databricks_mount code genration for exporter tooling (#1006).
  • Increase dependency check frequency (#1007).
  • Added experimental resources.

v0.4.2

24 Dec 12:38
57c2a95

Choose a tag to compare

  • Added optional auth_type provider conf to enforce specific auth type to be used in very rare cases, where a single Terraform state manages Databricks workspaces on more than one cloud and More than one authorization method configured error is a false positive. Valid values are pat, basic, azure-client-secret, azure-msi, azure-cli, and databricks-cli (#1000).
  • Added DBC format support for databricks_notebook (#989).
  • Fixed creating new databricks_mws_workspaces with token {} block (#994).
  • Added automated documentation formatting with make fmt-docs, so that all HCL examples look consistent (#999).
  • Increased codebase unit test coverage to 91% to improve stability (#996, #992, #991, #990).

Updated dependency versions:

  • Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.10.0 to 2.10.1

v0.4.1

16 Dec 11:36
da93abe

Choose a tag to compare

  • Added databricks_library resource to install library on databricks_cluster (#904).
  • Added databricks_clusters data resource to list all clusters in the workspace, which might be used to install databricks_library on all clusters (#955).
  • Fixed refresh of library blocks on a stopped databricks_cluster (#952).
  • Whenever a library fails to get installed on a running databricks_cluster, we now automatically remove this library, so that the clean state of managed libraries is properly maintained. Without this fix users had to manually go to Clusters UI and remove library from a cluster, where it failed to install. Libraries add up to CREATE and UPDATE timeouts of databricks_cluster resource. (#599).
  • Added token block to databricks_mws_workspaces to avoid unnecessary provider aliasing (#957).
  • Fixed disabling databricks_global_init_script (#958).
  • Fixed configuration drift issues with aws_attributes, azure_attributes, gcp_attributes, and email_notifications configuration blocks in databricks_cluster, databricks_job, and databricks_instance_pool resources (#981).
  • Improved Databricks CLI auth by eagerly resolving host, username, password, and token from the specified profile. Added explicit logging of auth parameters in debug logs (#965).
  • TLS timeouts, which may occur during Azure MSI auth, are no longer failing API requests and retried within a normal policy (#966).
  • debug_headers provider conf is also logging the Host header to help troubleshooting auth issues (#964).
  • Added new experimental resources and increased test coverage.

Updated dependency versions:

  • Bump github.com/golang-jwt/jwt/v4 from 4.1.0 to 4.2.0
  • Bump google.golang.org/api from 0.60.0 to 0.63.0
  • Bump github.com/Azure/go-autorest/autorest from 0.11.22 to 0.11.23
  • Bump github.com/Azure/go-autorest/autorest/azure/auth from 0.5.9 to 0.5.10
  • Bump gopkg.in/ini.v1 from 1.66.0 to 1.66.2
  • Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.9.0 to 2.10.0

v0.4.0

09 Dec 14:05

Choose a tag to compare

0.4.0

  • Added databricks_mlflow_model and databricks_mlflow_experiment resources (#931)
  • Added support for repo_path to databricks_permissions resource (#875).
  • Added external_id to databricks_user and databricks_group (#927).
  • Fixed databricks_repo creation corner cases on MS Windows OS (#911).
  • Fixed configuration drift for databricks_cluster.aws_attributes.zone_id with auto, which resulted in unwanted cluster restarts (#937).
  • Added new experimental resources, increased test coverage, and automated integration testing infrastructure.
  • Multiple documentation improvements and new guides.

Behavior changes

  • Renamed allow_sql_analytics_access to databricks_sql_access in databricks_user, databricks_group, and databricks_service_principal resources.
  • Removed deprecated azure_use_pat_for_spn, azure_use_pat_for_cli, azure_pat_token_duration_seconds provider attributes.
  • Removed deprecated azure_workspace_name, azure_resource_group, azure_subscription_id in favor of just using azure_workspace_resource_id.
  • Renamed DATABRICKS_AZURE_WORKSPACE_RESOURCE_ID environment variable to DATABRICKS_AZURE_RESOURCE_ID.
  • DATABRICKS_AZURE_CLIENT_SECRET environment variable is no longer having any effect in favor of just using ARM_CLIENT_SECRET.
  • DATABRICKS_AZURE_CLIENT_ID environment variable is no longer having any effect in favor of just using ARM_CLIENT_ID.
  • DATABRICKS_AZURE_TENANT_ID environment variable is no longer having any effect in favor of just using ARM_TENANT_ID.

Updated dependency versions:

  • Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.7.1 to 2.9.0
  • Bump github.com/Azure/go-autorest/autorest/adal from 0.9.16 to 0.9.17
  • Bump github.com/golang-jwt/jwt/v4 from 4.0.0 to 4.1.0
  • Bump github.com/zclconf/go-cty from 1.9.1 to 1.10.0
  • Bump github.com/Azure/go-autorest/autorest from 0.11.21 to 0.11.22

v0.3.11

10 Nov 20:04
70a47c6

Choose a tag to compare

0.3.11

  • Added databricks_sql_global_config resource to provide global configuration for SQL Endpoints (#855)
  • Added databricks_mount resource to mount arbitrary cloud storage (#497)
  • Improved implementation of databricks_repo by creating the parent folder structure (#895)
  • Fixed databricks_job error related to randomized job IDs (#901)
  • Replace databricks_group on name change (#890)
  • Names of scopes in databricks_secret_scope can have / characters in them (#892)

Deprecations

  • databricks_aws_s3_mount, databricks_azure_adls_gen1_mount, databricks_azure_adls_gen2_mount, and databricks_azure_blob_mount are deprecated in favor of databricks_mount.

Updated dependency versions:

  • Bump google.golang.org/api from 0.59.0 to 0.60.0

v0.3.10

29 Oct 19:29

Choose a tag to compare

  • Added private_access_level and allowed_vpc_endpoint_ids to databricks_mws_private_access_settings resource, which is also now updatable (#867).
  • Fixed missing diff skip for skip_validation in databricks_instance_profile (#860).
  • Added support for pipeline_task (871) and python_wheel_task (#872) to databricks_job.
  • Improved enterprise HTTPS proxy support for creating workspaces in PrivateLink environments (#882).
  • Added hostname attribute to odbc_params in databricks_sql_endpoint (#868).
  • Improved documentation (#858, #870).

Updated dependency versions:

  • Bumped google.golang.org/api from 0.58.0 to 0.59.0

v0.3.9

14 Oct 17:11

Choose a tag to compare

  • Added initial support for multiple task orchestration in databricks_job #853
  • Fixed provider crash for new terraform states related to bug #813 in Terraform SDK v2.8.0 (#854)
  • Re-added skip_validation to databricks_instance_profile resource #762
  • Removed direct dependency on aws-sdk-go.

Updated dependency versions:

  • Reverted github.com/hashicorp/terraform-plugin-sdk/v2 from 2.8.0 to 2.7.0

v0.3.8

07 Oct 13:50

Choose a tag to compare

  • Added databricks_repo resource to manage Databricks Repos (#771)
  • Added support for Azure MSI authentication (#743)
  • Added support to create databricks_user on the account level (#818)
  • Already deleted databricks_token don't fail the apply (#808)
  • Default terraform-mount clusters created for mounting for databricks_aws_s3_mount, databricks_azure_adls_gen1_mount, databricks_azure_adls_gen2_mount, and databricks_azure_blob_mount have now spark.scheduler.mode as FIFO (#828)
  • Fixed crash when using non-Azure authentication to mount Azure resources (#831)
  • Fixed replacement of instance_pool_id in databricks_cluster, when driver_instance_pool_id was not explicitly specified (#824)
  • Ignorning diff customization for permissions resource, so that new workspace deployments won't fail without explicit dependency on a workspace resource
  • Multiple documentation improvements

Deprecations

  • azure_workspace_name, azure_resource_group, azure_subscription_id, and azure_workspace_resource_id are deprecated and would be removed in v0.4.0. Please rewrite provider configuration with host = data.azurerm_databricks_workspace.example.workspace_url to achieve the same effect. Please check azurerm_databricks_workspace resource documentation for details.
  • azure_use_pat_for_spn, azure_use_pat_for_cli, and azure_pat_token_duration_seconds are deprecated to fully switch to AAD token authentication in the near future.
  • DATABRICKS_AZURE_CLIENT_SECRET environment variable is deprecated in favor of just using ARM_CLIENT_SECRET.
  • DATABRICKS_AZURE_CLIENT_ID environment variable is deprecated in favor of just using ARM_CLIENT_ID.
  • DATABRICKS_AZURE_TENANT_ID environment variable is deprecated in favor of just using ARM_TENANT_ID.

Updated dependency versions:

  • Bump github.com/aws/aws-sdk-go from 1.40.19 to 1.40.54
  • Bump github.com/Azure/go-autorest/autorest from 0.11.19 to 0.11.21
  • Bump github.com/Azure/go-autorest/autorest/azure/cli from 0.4.2 to 0.4.3
  • Bump github.com/Azure/go-autorest/autorest/adal from 0.9.14 to 0.9.16
  • Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.7.0 to 2.8.0
  • Bump github.com/zclconf/go-cty from 1.9.0 to 1.9.1
  • Bump golang.org/x/mod from 0.4.2 to 0.5.1
  • Bump google.golang.org/api from 0.52.0 to 0.58.0
  • Bump gopkg.in/ini.v1 from 1.62.0 to 1.63.2