v0.73.0

Release v0.73.0

Security

• Update protobuf dependency constraints to exclude known vulnerable versions (related to SNYK-PYTHON-PROTOBUF-10364902).

v0.72.0

Release v0.72.0

Bug Fixes

• Fix FilesExt can fail to upload and download data when Presigned URLs are not available in certain environments (e.g. Serverless GPU clusters).

• Fix FilesExt.upload and FilesExt.upload_from would fail when the source content is empty and use_parallel=True.

API Changes

• Add google_ads, tiktok_ads, salesforce_marketing_cloud, hubspot, workday_hcm, guidewire and zendesk enum values for databricks.sdk.service.pipelines.IngestionSourceType.
• Add batch_create_materialized_features() method for w.feature_engineering workspace-level service.
• Add lineage_context field for databricks.sdk.service.ml.Feature.
• Add autoscale_v2 enum value for databricks.sdk.service.compute.EventDetailsCause.
• Add unsupported_conversation_type_exception enum value for databricks.sdk.service.dashboards.MessageErrorType.
• Add red_state and yellow_state enum values for databricks.sdk.service.vectorsearch.EndpointStatusState.
• [Breaking] Change table_names field for databricks.sdk.service.jobs.TableUpdateTriggerConfiguration to be required.
• Change table_names field for databricks.sdk.service.jobs.TableUpdateTriggerConfiguration to be required.

v0.71.0

Release v0.71.0

Bug Fixes

• Fix the issue where FilesExt.upload's second parameter was changed from contents to content unintentionally. Now the interface is backward compatible to versions previous than 0.69.0.

API Changes

• Add instance_profile_arn field for databricks.sdk.service.compute.InstancePoolAwsAttributes.
• Add continuous, sliding and tumbling fields for databricks.sdk.service.ml.TimeWindow.
• Add usage_policy_id field for databricks.sdk.service.pipelines.CreatePipeline.
• Add usage_policy_id field for databricks.sdk.service.pipelines.EditPipeline.
• Add usage_policy_id field for databricks.sdk.service.pipelines.PipelineSpec.
• Add read_files_bytes field for databricks.sdk.service.sql.QueryMetrics.
• Add select enum value for databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurablePermission.
• Add table enum value for databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurableType.
• Add decommission_started and decommission_ended enum values for databricks.sdk.service.compute.EventType.
• Add dbr_image_resolution_failure enum value for databricks.sdk.service.compute.TerminationReasonCode.
• Add dbr_image_resolution_failure enum value for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change offline_store_config and online_store_config fields for databricks.sdk.service.ml.MaterializedFeature to no longer be required.
• Change offline_store_config and online_store_config fields for databricks.sdk.service.ml.MaterializedFeature to no longer be required.
• [Breaking] Change lifecycle_state field for databricks.sdk.service.sql.AlertV2 to type databricks.sdk.service.sql.AlertLifecycleState dataclass.
• [Breaking] Remove table field for databricks.sdk.service.jobs.TriggerSettings.
• [Breaking] Remove duration and offset fields for databricks.sdk.service.ml.TimeWindow.

v0.70.0

Release v0.70.0

Bug Fixes

• Improving the error message that is shown when the unsupported dbutils.credentials.getServiceCredentialsProvider method is used. This method can only be used inside of a notebook.

API Changes

• Add create_materialized_feature(), delete_materialized_feature(), get_materialized_feature(), list_materialized_features() and update_materialized_feature() methods for w.feature_engineering workspace-level service.
• Add filter_condition field for databricks.sdk.service.ml.Feature.
• Add absolute_session_lifetime_in_minutes and enable_single_use_refresh_tokens fields for databricks.sdk.service.oauth2.TokenAccessPolicy.
• Add network_connectivity_config_id field for databricks.sdk.service.provisioning.CreateWorkspaceRequest.
• Add oauth_mtls enum value for databricks.sdk.service.catalog.CredentialType.
• Add network_check_nic_failure_due_to_misconfig, network_check_dns_server_failure_due_to_misconfig, network_check_storage_failure_due_to_misconfig, network_check_metadata_endpoint_failure_due_to_misconfig, network_check_control_plane_failure_due_to_misconfig and network_check_multiple_components_failure_due_to_misconfig enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Add creating and create_failed enum values for databricks.sdk.service.settings.NccPrivateEndpointRulePrivateLinkConnectionState.
• Add network_check_nic_failure_due_to_misconfig, network_check_dns_server_failure_due_to_misconfig, network_check_storage_failure_due_to_misconfig, network_check_metadata_endpoint_failure_due_to_misconfig, network_check_control_plane_failure_due_to_misconfig and network_check_multiple_components_failure_due_to_misconfig enum values for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change display_name, evaluation, query_text, schedule and warehouse_id fields for databricks.sdk.service.sql.AlertV2 to be required.
• Change display_name, evaluation, query_text, schedule and warehouse_id fields for databricks.sdk.service.sql.AlertV2 to be required.
• Change comparison_operator and source fields for databricks.sdk.service.sql.AlertV2Evaluation to be required.
• [Breaking] Change comparison_operator and source fields for databricks.sdk.service.sql.AlertV2Evaluation to be required.
• Change name field for databricks.sdk.service.sql.AlertV2OperandColumn to be required.
• [Breaking] Change name field for databricks.sdk.service.sql.AlertV2OperandColumn to be required.
• [Breaking] Change quartz_cron_schedule and timezone_id fields for databricks.sdk.service.sql.CronSchedule to be required.
• Change quartz_cron_schedule and timezone_id fields for databricks.sdk.service.sql.CronSchedule to be required.
• [Breaking] Remove update() method for w.recipient_federation_policies workspace-level service.
• [Breaking] Remove results field for databricks.sdk.service.sql.ListAlertsV2Response.

v0.69.0

Release v0.69.0

New Features and Improvements

• Add a new interface upload_from to databricks.sdk.mixins.FilesExt to support upload from a file in local filesystem.
• Improve databricks.sdk.mixins.FilesExt upload throughput by uploading data in parallel by default.
• Add a new interface download_to to databricks.sdk.mixins.FilesExt to support download to a file in local filesystem. This interface will also download the file in parallel by default. Parallel downloading is currently unavailable on Windows.
• Improve databricks.sdk.mixins.FilesExt.upload to support uploading when Presigned URL is not enabled for the Workspace by introducing a fallback to Single Part Upload.

API Changes

• Add upload_from(), download_to() method for databricks.sdk.mixins.FilesExt.
• Add use_parallel, parallelism, part_size field for databricks.sdk.mixins.FilesExt.upload.
• [Breaking] Change files_api_client_download_max_total_recovers to files_ext_client_download_max_total_recovers for databricks.sdk.Config
• [Breaking] Change files_api_client_download_max_total_recovers_without_progressing to files_ext_client_download_max_total_recovers_without_progressing for databricks.sdk.Config
• [Breaking] Change multipart_upload_min_stream_size to files_ext_multipart_upload_min_stream_size for databricks.sdk.Config
• [Breaking] Change multipart_upload_batch_url_count to files_ext_multipart_upload_batch_url_count for databricks.sdk.Config
• [Breaking] Change multipart_upload_chunk_size to files_ext_multipart_upload_default_part_size for databricks.sdk.Config
• [Breaking] Change multipart_upload_url_expiration_duration to files_ext_multipart_upload_url_expiration_duration for databricks.sdk.Config
• [Breaking] Change multipart_upload_max_retries to files_ext_multipart_upload_max_retries for databricks.sdk.Config
• Add files_ext_client_download_streaming_chunk_size, files_ext_multipart_upload_part_size_options, files_ext_multipart_upload_max_part_size, files_ext_multipart_upload_default_parallelism, files_ext_presigned_download_url_expiration_duration, files_ext_parallel_download_default_parallelism, files_ext_parallel_download_min_file_size, files_ext_parallel_download_default_part_size, files_ext_parallel_download_max_retries for databricks.sdk.Config

v0.68.0

Release v0.68.0

New Features and Improvements

• Add native support for authentication through Azure DevOps OIDC.

Bug Fixes

• Fix a security issue that resulted in bearer tokens being logged in exception messages.

API Changes

• Add databricks.sdk.service.dataquality package.
• Add w.data_quality workspace-level service.
• Add create_update() and get_update() methods for w.apps workspace-level service.
• Add compute_size field for databricks.sdk.service.apps.App.
• Add genie_space field for databricks.sdk.service.apps.AppResource.
• Add skip_validation field for databricks.sdk.service.catalog.AccountsCreateStorageCredential.
• Add skip_validation field for databricks.sdk.service.catalog.AccountsUpdateStorageCredential.
• Add aliases, browse_only, created_at, created_by, full_name, metastore_id, owner, updated_at and updated_by fields for databricks.sdk.service.catalog.CreateRegisteredModelRequest.
• Add catalog_name, id, model_name and schema_name fields for databricks.sdk.service.catalog.RegisteredModelAlias.
• Add aliases, catalog_name, created_at, created_by, id, metastore_id, model_name, model_version_dependencies, run_id, run_workspace_id, schema_name, source, status, storage_location, updated_at and updated_by fields for databricks.sdk.service.catalog.UpdateModelVersionRequest.
• Add aliases, browse_only, catalog_name, created_at, created_by, metastore_id, name, schema_name, storage_location, updated_at and updated_by fields for databricks.sdk.service.catalog.UpdateRegisteredModelRequest.
• Add key_region field for databricks.sdk.service.provisioning.CreateAwsKeyInfo.
• Add role_arn field for databricks.sdk.service.provisioning.CreateStorageConfigurationRequest.
• Add azure_key_info field for databricks.sdk.service.provisioning.CustomerManagedKey.
• [Breaking] Add customer_facing_private_access_settings field for databricks.sdk.service.provisioning.ReplacePrivateAccessSettingsRequest.
• Add role_arn field for databricks.sdk.service.provisioning.StorageConfiguration.
• [Breaking] Add customer_facing_workspace field for databricks.sdk.service.provisioning.UpdateWorkspaceRequest.
• Add update_mask field for databricks.sdk.service.provisioning.UpdateWorkspaceRequest.
• Add compute_mode, network, network_connectivity_config_id and storage_mode fields for databricks.sdk.service.provisioning.Workspace.
• Add enable_serverless_compute field for databricks.sdk.service.sql.GetWorkspaceWarehouseConfigResponse.
• Add page_size and page_token fields for databricks.sdk.service.sql.ListWarehousesRequest.
• Add next_page_token field for databricks.sdk.service.sql.ListWarehousesResponse.
• Add enable_serverless_compute field for databricks.sdk.service.sql.SetWorkspaceWarehouseConfigRequest.
• Add model_version_status_unknown enum value for databricks.sdk.service.catalog.ModelVersionInfoStatus.
• Add k8s_active_pod_quota_exceeded and cloud_account_pod_quota_exceeded enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Add internal_catalog_asset_creation_ongoing_exception, internal_catalog_asset_creation_failed_exception and internal_catalog_asset_creation_unsupported_exception enum values for databricks.sdk.service.dashboards.MessageErrorType.
• Add ssh_bootstrap_failure, aws_inaccessible_kms_key_failure, init_container_not_finished, spark_image_download_throttled, spark_image_not_found, cluster_operation_throttled, cluster_operation_timeout, serverless_long_running_terminated, azure_packed_deployment_partial_failure, invalid_worker_image_failure, workspace_update, invalid_aws_parameter, driver_out_of_disk, driver_out_of_memory, driver_launch_timeout, driver_unexpected_failure, unexpected_pod_recreation, gcp_inaccessible_kms_key_failure, gcp_kms_key_permission_denied, driver_eviction, user_initiated_vm_termination, gcp_iam_timeout, aws_resource_quota_exceeded, cloud_account_setup_failure, aws_invalid_key_pair, driver_pod_creation_failure, maintenance_mode, internal_capacity_failure, executor_pod_unscheduled, storage_download_failure_slow, storage_download_failure_throttled, dynamic_spark_conf_size_exceeded, aws_instance_profile_update_failure, instance_pool_not_found, instance_pool_max_capacity_reached, aws_invalid_kms_key_state, gcp_insufficient_capacity, gcp_api_rate_quota_exceeded, gcp_resource_quota_exceeded, gcp_ip_space_exhausted, gcp_service_account_access_denied, gcp_service_account_not_found, gcp_forbidden, gcp_not_found, resource_usage_blocked, data_access_config_changed, access_token_failure, invalid_instance_placement_protocol, budget_policy_resolution_failure, in_penalty_box, disaster_recovery_replication, bootstrap_timeout_due_to_misconfig, instance_unreachable_due_to_misconfig, storage_download_failure_due_to_misconfig, control_plane_request_failure_due_to_misconfig, cloud_provider_launch_failure_due_to_misconfig, gcp_subnet_not_ready, cloud_operation_cancelled, cloud_provider_instance_not_launched, gcp_trusted_image_projects_violated, budget_policy_limit_enforcement_activated, eos_spark_image, no_matched_k8s, lazy_allocation_timeout, driver_node_unreachable, secret_creation_failure, pod_scheduling_failure, pod_assignment_failure, allocation_timeout, allocation_timeout_no_unallocated_clusters, allocation_timeout_no_matched_clusters, allocation_timeout_no_ready_clusters, allocation_timeout_no_warmed_up_clusters, allocation_timeout_node_daemon_not_ready, allocation_timeout_no_healthy_clusters, netvisor_setup_timeout, no_matched_k8s_testing_tag, cloud_provider_resource_stockout_due_to_misconfig, gke_based_cluster_termination, allocation_timeout_no_healthy_and_warmed_up_clusters, docker_invalid_os_exception, docker_container_creation_exception, docker_image_too_large_for_instance_exception, dns_resolution_error, gcp_denied_by_org_policy, secret_permission_denied, network_check_nic_failure, network_check_dns_server_failure, network_check_storage_failure, network_check_metadata_endpoint_failure, network_check_control_plane_failure, network_check_multiple_components_failure, driver_unhealthy, security_agents_failed_initial_verification, driver_dns_resolution_failure, no_activated_k8s, usage_policy_entitlement_denied, no_activated_k8s_testing_tag, k8s_active_pod_quota_exceeded and cloud_account_pod_quota_exceeded enum values for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change create() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsCreateMetastoreAssignmentResponse dataclass.
• [Breaking] Change delete() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteMetastoreAssignmentResponse dataclass.
• [Breaking] Change update() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsUpdateMetastoreAssignmentResponse dataclass.
• [Breaking] Change create() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsCreateMetastoreResponse dataclass.
• [Breaking] Change delete() method for a.account_metastores account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteMetastoreResponse dataclass.
• [Breaking] Change get() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsGetMetastoreResponse dataclass.
• [Breaking] Change list() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsListMetastoresResponse dataclass.
• [Breaking] Change update() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsUpdateMetastoreResponse dataclass.
• [Breaking] Change create() method for a.account_storage_credentials account-level service to return databricks.sdk.service.catalog.AccountsCreateStorageCredentialInfo dataclass.
• [Breaking] Change delete() method for a.account_storage_credentials account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteStorageCredentialResponse dataclass.
• [Breaking] Change update() method for a.account_storage_credentials account-level service to return `databricks.sdk.service.ca...

v0.67.0

Release v0.67.0

API Changes

• Add update_notifications() method for w.serving_endpoints workspace-level service.
• Add parameters field for databricks.sdk.service.dashboards.GenieQueryAttachment.
• Add database_instance_name field for databricks.sdk.service.database.CreateDatabaseInstanceRoleRequest.
• Add custom_tags, effective_custom_tags, effective_usage_policy_id and usage_policy_id fields for databricks.sdk.service.database.DatabaseInstance.
• Add effective_attributes and instance_name fields for databricks.sdk.service.database.DatabaseInstanceRole.
• Add external_use_schema enum value for databricks.sdk.service.catalog.Privilege.
• Add stream_native enum value for databricks.sdk.service.catalog.SystemType.
• Add exceeded_max_token_length_exception enum value for databricks.sdk.service.dashboards.MessageErrorType.
• Change name field for databricks.sdk.service.database.DatabaseInstanceRole to be required.
• [Breaking] Change name field for databricks.sdk.service.database.DatabaseInstanceRole to be required.

v0.66.0

Release v0.66.0

New Features and Improvements

• Add a public helper function to build a CredentialsProvider directly from an IdTokenSource.

API Changes

• Added databricks.sdk.service.iamv2 package.
• Added a.account_groups_v2 account-level service, a.account_service_principals_v2 account-level service, a.account_users_v2 account-level service, w.groups_v2 workspace-level service, w.service_principals_v2 workspace-level service and w.users_v2 workspace-level service.
• Added a.account_iam_v2 account-level service and w.workspace_iam_v2 workspace-level service.
• Added w.feature_engineering workspace-level service.
• Added java_dependencies field for databricks.sdk.service.compute.Environment.
• Added followup_questions field for databricks.sdk.service.dashboards.GenieAttachment.
• Added feedback field for databricks.sdk.service.dashboards.GenieMessage.
• Added effective_capacity field for databricks.sdk.service.database.DatabaseInstance.
• Added disabled field for databricks.sdk.service.jobs.Task.
• Added netsuite_jar_path field for databricks.sdk.service.pipelines.IngestionPipelineDefinition.
• Added workday_report_parameters field for databricks.sdk.service.pipelines.TableSpecificConfig.
• Added auxiliary_managed_location field for databricks.sdk.service.sharing.TableInternalAttributes.
• Added alerts field for databricks.sdk.service.sql.ListAlertsV2Response.
• Added create_time and update_time fields for databricks.sdk.service.tags.TagPolicy.
• Added table_delta_uniform_iceberg_foreign_deltasharing enum value for databricks.sdk.service.catalog.SecurableKind.
• Added no_activated_k8s and usage_policy_entitlement_denied enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Added internal_catalog_path_overlap_exception and internal_catalog_missing_uc_path_exception enum values for databricks.sdk.service.dashboards.MessageErrorType.
• Added foreign_catalog enum value for databricks.sdk.service.pipelines.IngestionSourceType.
• Added foreign_iceberg_table enum value for databricks.sdk.service.sharing.TableInternalAttributesSharedTableType.
• [Breaking] Removed disabled field for databricks.sdk.service.jobs.RunTask.
• [Breaking] Removed default_data_security_mode and effective_default_data_security_mode fields for databricks.sdk.service.settingsv2.Setting.
• Added list_shares() method for w.shares workspace-level service.
• Added suggested_questions field for databricks.sdk.service.dashboards.GenieAttachment.
• Added warehouse_id field for databricks.sdk.service.dashboards.GenieSpace.
• Added palantir enum value for databricks.sdk.service.catalog.ConnectionType.
• Added table_metric_view_deltasharing and table_foreign_palantir enum values for databricks.sdk.service.catalog.SecurableKind.
• Added no_activated_k8s_testing_tag enum value for databricks.sdk.service.compute.TerminationReasonCode.
• Added metric_view enum value for databricks.sdk.service.sharing.TableInternalAttributesSharedTableType.
• [Breaking] Removed followup_questions field for databricks.sdk.service.dashboards.GenieAttachment.
• [Breaking] Removed comment field for databricks.sdk.service.dashboards.GenieFeedback.
• [Breaking] Removed comment field for databricks.sdk.service.dashboards.GenieSendMessageFeedbackRequest.

v0.65.0

## Release v0.65.0

### New Features and Improvements

* Added support for passing additional kwargs to `WorkspaceClient().serving_endpoints.get_open_ai_client()` ([#1025](https://github.com/databricks/databricks-sdk-py/pull/1025)). Users can now pass standard OpenAI client parameters like `timeout` and `max_retries` when creating an OpenAI client for Databricks Model Serving.

### API Changes
* Added `comment` field for `databricks.sdk.service.dashboards.GenieSendMessageFeedbackRequest`.
* [Breaking] Added `rating` field for `databricks.sdk.service.dashboards.GenieSendMessageFeedbackRequest`.
* Added `effective_enable_pg_native_login` and `enable_pg_native_login` fields for `databricks.sdk.service.database.DatabaseInstance`.
* Added `task_retry_mode` field for `databricks.sdk.service.jobs.Continuous`.
* Added `source_configurations` field for `databricks.sdk.service.pipelines.IngestionPipelineDefinition`.
* Added `app_id`, `app_id_set`, `auth_secret`, `auth_secret_set`, `channel_url`, `channel_url_set`, `tenant_id` and `tenant_id_set` fields for `databricks.sdk.service.settings.MicrosoftTeamsConfig`.
* Added `ensure_reranker_compatible` field for `databricks.sdk.service.vectorsearch.GetIndexRequest`.
* Added `reranker` field for `databricks.sdk.service.vectorsearch.QueryVectorIndexRequest`.
* [Breaking] Changed `create_clean_room_asset_review()` method for [w.clean_room_assets](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/cleanrooms/clean_room_assets.html) workspace-level service with new required argument order.
* [Breaking] Changed `send_message_feedback()` method for [w.genie](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/dashboards/genie.html) workspace-level service with new required argument order.
* Changed `notebook_review` field for `databricks.sdk.service.cleanrooms.CreateCleanRoomAssetReviewRequest` to no longer be required.
* [Breaking] Changed `features` field for `databricks.sdk.service.ml.FeatureList` to type list[`databricks.sdk.service.ml.LinkedFeature`] dataclass.
* [Breaking] Removed `feedback_rating` and `feedback_text` fields for `databricks.sdk.service.dashboards.GenieSendMessageFeedbackRequest`.

v0.64.0

Release v0.64.0

API Changes

• Added databricks.sdk.service.settingsv2 and databricks.sdk.service.tags packages.
• Added w.apps_settings workspace-level service.
• Added w.entity_tag_assignments workspace-level service and w.rfa workspace-level service.
• Added a.account_settings_v2 account-level service and w.workspace_settings_v2 workspace-level service.
• Added w.tag_policies workspace-level service.
• Added delete_conversation_message(), list_conversation_messages() and send_message_feedback() methods for w.genie workspace-level service.
• Added include_all field for databricks.sdk.service.dashboards.GenieListConversationsRequest.
• Added effective_usage_policy_id field for databricks.sdk.service.jobs.BaseJob.
• Added effective_usage_policy_id field for databricks.sdk.service.jobs.BaseRun.
• Added effective_usage_policy_id field for databricks.sdk.service.jobs.Job.
• Added effective_usage_policy_id field for databricks.sdk.service.jobs.Run.
• Added tokens field for databricks.sdk.service.serving.AiGatewayRateLimit.
• Added usage_policy_id field for databricks.sdk.service.serving.ServingEndpoint.
• Added effective_run_as and run_as fields for databricks.sdk.service.sql.AlertV2.
• Added cache_query_id field for databricks.sdk.service.sql.QueryInfo.
• Added model_endpoint_name_for_query field for databricks.sdk.service.vectorsearch.EmbeddingSourceColumn.
• [Breaking] Removed environment_settings field for databricks.sdk.service.catalog.ConnectionInfo.
• [Breaking] Removed environment_settings field for databricks.sdk.service.catalog.CreateConnection.
• [Breaking] Removed environment_settings field for databricks.sdk.service.catalog.UpdateConnection.
• [Breaking] Removed comment, display_name and tags fields for databricks.sdk.service.sharing.Share.