v0.3.7

• Added databricks_obo_token resource to create On-Behalf-Of tokens for a Service Principal in Databricks workspaces on AWS. It is very useful, when you want to provision resources within a workspace through narrowly-scoped service principal, that has no access to other workspaces within the same Databricks Account (#736)
• Added support for IAM credential passthrough with is_meta_instance_profile property for databricks_instance_profile (#745)
• Fixed incorrect workspace update bug and added more validation error messaging (#649)
• Clarify network modification procedure on active workspaces (#732)
• Updated AWS IAM policy templates version to 2012-10-17 (databricks_aws_bucket_policy, databricks_aws_assume_role_policy, and databricks_aws_crossaccount_policy) (#688)
• Azure mounts now respect Azure Environment settings (#681)
• Various bug fixes in Databricks SQL resources

Updated dependency versions:

• Bump github.com/aws/aws-sdk-go to v1.40.12
• Bump github.com/hashicorp/hcl/v2 to v2.10.1
• Bump github.com/zclconf/go-cty to v1.9.0
• Bump golang.org/x/time to v0.0.0-20210723032227-1f47c861a9ac
• Bump golang.org/x/tools to v0.1.5

v0.3.6

• Added support for hybrid pools (#689)
• Added support for always_running jobs, which are restarted on resource updates (#715)
• Azure CLI auth is now forcing JSON output (#717)
• databricks_permissions are getting validation on terraform plan stage (#706)
• Added databricks_directory resource (#690)
• Added run_as_role field to databricks_sql_query (#684)
• Added user_id attribute for databricks_user data resource, so that it's possible to dynamically create resources based on members of the group (#714)
• Added more selectors to databricks_node_type data source (#723)
• Azure auth with SPN now uses AAD token by default instead of PAT. Previous behavior (using PAT) could be restored by setting azure_use_pat_for_spn to true (#721)
• deployment_name for databricks_mws_workspaces is now optional, how it should have been. This enables creation of Databricks workspaces without an account prefix.
• To replicate default behavior of Databricks SQL UI, enable_photon is now true by default for databricks_sql_endpoint.
• Various documentation and bugfixes

Updated dependency versions:

• Bump github.com/aws/aws-sdk-go from 1.38.51 to 1.38.71
• Bump github.com/Azure/go-autorest/autorest/azure/auth from 0.5.7 to 0.5.8
• Bump github.com/Azure/go-autorest/autorest from 0.11.18 to 0.11.19
• Bump github.com/Azure/go-autorest/autorest/adal from 0.9.13 to 0.9.14
• Bump github.com/zclconf/go-cty from 1.8.3 to 1.8.4
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.6.1 to 2.7.0

v0.3.5

0.3.5

• Fixed setting of permissions for SQLA endpoints (#661)
• Added support for preloading of Docker images into instance pools (#663)
• Added the databricks_user data source (#648)
• Fixed support for spot_instance_policy in SQLA Endpoints (#665)
• Added documentation for databricks_pipeline resource (#673)
• Fixed mapping for databricks_service_principal on AWS (#656)
• Made preview environment tests to run on a release basis

Updated dependency versions:

• Bump github.com/zclconf/go-cty from 1.8.2 to 1.8.3
• Bump github.com/aws/aws-sdk-go from 1.38.30 to 1.38.51

v0.3.4

• Fixed state refresh bugs in databricks_sql_permissions (#620, #619)
• Fixed workspace_ids_filter mapping for databricks_mws_log_delivery (#635)
• Multiple documentation improvements (#597, eb60d10, edcd4b1, 404bdab, #615, f14b825, e615c3a, #612)
• Mounting clusters are recreated now, even when they are deleted (#637)
• Fixed handling of empty blocks for clusters/jobs/instance pools (22cdf2f)
• Mark instance pool attributes as ForceNew when it's requited (#629)
• Switched to use https://staticcheck.io/ for static code analysis (#602)

Behavior changes

• The customer_managed_key_id field in databricks_mws_workspaces resource is deprecated and should be replaced with managed_services_customer_managed_key_id (and optionally storage_customer_managed_key_id). databricks_mws_customer_managed_keys now requires the parameter use_cases (#642). If you've used the resource before, please add use_cases = ["MANAGED_SERVICES"] to keep the behaviour.

Updated dependency versions:

• Bump github.com/aws/aws-sdk-go to v1.38.30
• Bump github.com/hashicorp/go-retryablehttp to v0.7.0
• Bump github.com/hashicorp/hcl/v2 to v2.10.0
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 to v2.6.1
• Bump github.com/zclconf/go-cty to v1.8.2

v0.3.3

• Added resources for SQL Analytics queries and dashboards: databricks_sql_query, databricks_sql_visualization, databricks_sql_dashboard, databricks_sql_widget (#553)
• Added databricks_sql_permissions resource (#545)
• Fixed documentation bugs (#603)
• Improved resource exporter (#593)
• Added missing properties to databricks_mws_private_access_settings (#590)
• Include SQLA data source ID in databricks_sql_endpoint state (#601)
• Apply debug_truncate_bytes also for response dumps (#589)
• More verbose logging of databricks_cluster termination reason (#588)
• Move non-auth provider config documentation into separate section (#587)

v0.3.2

• Fixed minor issues to add support for GCP (#558)
• Fixed databricks_permissions for SQL Analytics Entities (#535)
• Fixed incorrect HTTP 404 handling on create (#564, #576)
• Fixed incorrect escaping of notebook names (#566)
• Fixed entitlements for databricks_group (#549)
• Fixed rate limiting to perform more than 1 request per second (#577)
• Added support for spot instances on Azure (#571)
• Added job schedules support for pause_status as a optional field. (#575)
• Fixed minor documentation issues.

Updated dependency versions:

• Bump github.com/aws/aws-sdk-go from 1.37.20 to 1.38.10
• Bump github.com/hashicorp/hcl/v2 from 2.9.0 to 2.9.1
• Bump github.com/zclconf/go-cty from 1.8.0 to 1.8.1
• Bump github.com/google/go-querystring from 1.0.0 to 1.1.0

v0.3.1

• Added databricks_global_init_script resource to configure global init scripts (#487).
• Added databricks_sql_endpoint resource (#498)
• Added experimental resource exporter to generate configuration for entire workspace.
• Improved user-facing documentaiton (#508, #516, #511, #504, [#492](Update docs in various places))
• Simplified authentication issues debugging (#490)
• Made cleaner error message for no config profile (#491)
• Allow tokens without comment or expiration (#495)
• Ensured consistent slashes in notebook paths for different OSes (#500)
• Fix error message panic in command result parsing (#502)
• Updated databricks_group data resource to allow non-alphanumeric characters in group name filter (#507)

Behavior changes

• Assigning any permission to admins would result in an error, so that behavior is consistent (#486).

Updated dependency versions:

• github.com/zclconf/go-cty from 1.2.1 to 1.7.1
• github.com/Azure/go-autorest/autorest/azure/auth from 0.5.6 to 0.5.7
• github.com/hashicorp/hcl/v2 from 2.3.0 to 2.8.2
• github.com/aws/aws-sdk-go from 1.37.1 to 1.37.11
• github.com/Azure/go-autorest/autorest from 0.11.17 to 0.11.18

v0.3.0

• Added configurable provisioning timeout for databricks_mws_workspaces, so that local DNS cache issues would be more tolerated.
• Added databricks_current_user to simplify applying the same Terraform configuration by different users in the shared workspace for testing purposes.
• Added client-side rate limiting to release the pressure on backend APIs and prevent client blocking (#465)
• Member usernames, group names and instance profile names in databricks_group data source are now sorted and providing consistent behavior between runs (#449)
• Fixed redundant multiple mounting clusters (#445)
• Added optional parameter azure_environment to provider config which defaults to public (#437).
• Added databricks_service_principal resource.
• skip_validation from databricks_instance_profile was removed and is always set to true.
• Added propagation of terraform version to User-Agent header, along with type of resource used.
• databricks_notebook & databricks_dbfs_file got new source field to specify location of a local file.
• databricks_notebook can have language field optional, as long as source is set to a file with .py, .scala, .sql, or .r extension.
• databricks_me data source was added to represent user_name, home & id of the caller user (or service principal).
• Added validation for secret scope name in databricks_secret, databricks_secret_scope and databricks_secret_acl. Non-compliant names may cause errors.
• Added databricks_spark_version data source.
• Fixed support for single node clusters support by allowing num_workers to be 0.
• Fixed bug in destruction of IP access lists (#426).
• All resource imports are now making call to corresponding Databricks API by default (#471).

Behavior changes

• Removed deprecated library_jar, library_egg, library_whl, library_pypi, library_cran, and library_maven from databricks_cluster and databricks_job in favor of more API-transparent library configuration block.
• Removed deprecated notebook_path and notebook_base_parameters from databricks_job in favor of notebook_task configuration block.
• Removed deprecated jar_uri, jar_main_class_name, and jar_parameters from databricks_job in favor of spark_jar_task configuration block.
• Removed deprecated python_file and python_parameters from databricks_job in favor of spark_python_task configuration block.
• Removed deprecated spark_submit_parameters from databricks_job in favor of spark_submit_task configuration block.
• Removed deprecated databricks_scim_user resource in favor of databricks_user.
• Removed deprecated databricks_scim_group resource in favor of databricks_group.
• Removed deprecated databricks_default_user_roles data source in favor of databricks_group data source.
• Removed deprecated basic_auth and azure_auth provider configuration blocks in favor of documented authentication methods.
• format, overwrite, and mkdirs were removed from databricks_notebook. To follow expected behavior of Terraform, notebooks are always overwritten.
• skip_validation from databricks_instance_profile was removed and is always set to true for subsequent requests.
• databricks_mws_workspace got verify_workspace_runnning removed and now validates all every deployment. In case deployment failed, it removes workspace that failed and returns error message with explanation.
• default_tags were removed from databricks_instance_pool. disk_spec got new attribute disk_type, that contains azure_disk_volume_type and ebs_volume_type. This change is made to closer reflect API structure.
• databricks_notebook & databricks_dbfs_file got content attribute renamed to content_base64 and now share the same logic to work with local files.

v0.2.9

• Fixed documentation issues.
• Added missing resource importers and test to cover it.
• Migrated build from TravisCI to GitHub Actions.
• Fixed custom config_file issue configuration handling (#420).

Deprecations

• databricks_notebook has got overwrite, mkdirs and format parameters, that always have to be set to certain values in order to follow expected behavior of terraform. These fields would be removed in 0.3 and always set to proper values.
• databricks_notebook & databricks_dbfs_file field content is deprecated and would be renamed to content_base64 to further increase clarity.
• databricks_dbfs_file has got content, content_b64_md5, overwrite, mkdirs, validate_remote_file fields deprecated and they will be removed in the next version, where critical code path will be shared with databricks_notebook.
• network_error_messages and verify_workspace_runnning from databricks_mws_workspaces is deprecated and going to be removed in 0.3.
• error_messages from databricks_mws_networks are deprecated and would be removed in 0.3.
• ebs_volume_type and azure_disk_volume_type from databricks_instance_pool is going to be moved to disk_type sub-block in 0.3, which means you'll slightly have to modify configuration while migrating to 0.3. Computed field default_tags is going to be removed from resource. This is done to further increase maintainability of provider in the future.

Updated dependency versions:

• github.com/aws/aws-sdk-go 35.36
• github.com/hashicorp/go-retryablehttp 0.6.8
• github.com/Azure/go-autorest/autorest 0.11.12

Behavior changes

• min_idle_instances for databricks_instance_pool is now optional.
• skip_validation for databricks_instance_profile is going to be removed in 0.3.

v0.2.8

• Added databricks_workspace_conf resource.
• Added databricks_mws_log_delivery resource for billable usage & audit logs consumption.
• Added databricks_node_type data source for simpler selection of node types across AWS & Azure.
• Added Azure Key Vault support for databricks_secret_scope for Azure CLI authenticated users.
• Added is_pinned support for databricks_cluster resource.
• Fixed restarting cluster on changes in cluster configuration aren't related to the cluster configuration (issue #379)
• Fixed issue #383 by cleaning up clusters that fail to start.
• Fixed issue #382 by ignoring any incoming changes to deployment name of databricks_mws_workspaces, as well as propagating the right error messages.
• Internal: API for retrieval of the cluster events.
• Increased code coverage to 71%.

Updated dependency versions:

• github.com/Azure/go-autorest/autorest v0.11.9
• github.com/Azure/go-autorest/autorest/adal v0.9.5
• github.com/Azure/go-autorest/autorest/azure/auth v0.5.3
• github.com/Azure/go-autorest/autorest/azure/cli v0.4.2
• gopkg.in/ini.v1 1.62.0

Deprecations

• network_error_messages from databricks_mws_workspaces is deprecated and going to be removed in 0.3