Update databricks-sdk requirement from <0.39,>=0.38 to >=0.39,<0.40 (#3434)

Updates the requirements on
[databricks-sdk](https://github.com/databricks/databricks-sdk-py) to
permit the latest version.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/databricks/databricks-sdk-py/releases">databricks-sdk's
releases</a>.</em></p>
<blockquote>
<h2>v0.39.0</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Update Changelog file (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/830">#830</a>).</li>
</ul>
<h3>Internal Changes</h3>
<ul>
<li>Fix a couple of typos in open_ai_client.py (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/829">#829</a>).</li>
<li>Update SDK to OpenAPI spec (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/834">#834</a>).</li>
</ul>
<h3>API Changes:</h3>
<ul>
<li>Added <code>databricks.sdk.service.cleanrooms</code> package.</li>
<li>Added <code>delete()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/settings/aibi_dashboard_embedding_access_policy.html">w.aibi_dashboard_embedding_access_policy</a>
workspace-level service.</li>
<li>Added <code>delete()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/settings/aibi_dashboard_embedding_approved_domains.html">w.aibi_dashboard_embedding_approved_domains</a>
workspace-level service.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.CreateCredentialRequest</code>.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.CredentialInfo</code>.</li>
<li>Added <code>gcp_options</code> field for
<code>databricks.sdk.service.catalog.GenerateTemporaryServiceCredentialRequest</code>.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.UpdateCredentialRequest</code>.</li>
<li>Added <code>cached_query_schema</code> field for
<code>databricks.sdk.service.dashboards.QueryAttachment</code>.</li>
<li>Added .</li>
<li>Removed <code>gcp_service_account_key</code> field for
<code>databricks.sdk.service.catalog.CreateCredentialRequest</code>.</li>
</ul>
<p>OpenAPI SHA: 7016dcbf2e011459416cf408ce21143bcc4b3a25, Date:
2024-12-05</p>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/databricks/databricks-sdk-py/blob/main/CHANGELOG.md">databricks-sdk's
changelog</a>.</em></p>
<blockquote>
<h2>[Release] Release v0.39.0</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Update Changelog file (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/830">#830</a>).</li>
</ul>
<h3>Internal Changes</h3>
<ul>
<li>Fix a couple of typos in open_ai_client.py (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/829">#829</a>).</li>
<li>Update SDK to OpenAPI spec (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/834">#834</a>).</li>
</ul>
<h3>API Changes:</h3>
<ul>
<li>Added <code>databricks.sdk.service.cleanrooms</code> package.</li>
<li>Added <code>delete()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/settings/aibi_dashboard_embedding_access_policy.html">w.aibi_dashboard_embedding_access_policy</a>
workspace-level service.</li>
<li>Added <code>delete()</code> method for <a
href="https://databricks-sdk-py.readthedocs.io/en/latest/workspace/settings/aibi_dashboard_embedding_approved_domains.html">w.aibi_dashboard_embedding_approved_domains</a>
workspace-level service.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.CreateCredentialRequest</code>.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.CredentialInfo</code>.</li>
<li>Added <code>gcp_options</code> field for
<code>databricks.sdk.service.catalog.GenerateTemporaryServiceCredentialRequest</code>.</li>
<li>Added <code>databricks_gcp_service_account</code> field for
<code>databricks.sdk.service.catalog.UpdateCredentialRequest</code>.</li>
<li>Added <code>cached_query_schema</code> field for
<code>databricks.sdk.service.dashboards.QueryAttachment</code>.</li>
<li>Added .</li>
<li>Removed <code>gcp_service_account_key</code> field for
<code>databricks.sdk.service.catalog.CreateCredentialRequest</code>.</li>
</ul>
<p>OpenAPI SHA: 7016dcbf2e011459416cf408ce21143bcc4b3a25, Date:
2024-12-05</p>
<h2>[Release] Release v0.38.0</h2>
<h3>New Features and Improvements</h3>
<ul>
<li>Read streams by 1MB chunks by default. (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/817">#817</a>).</li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li>Rewind seekable streams before retrying (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/821">#821</a>).</li>
<li>Properly serialize nested data classes.</li>
</ul>
<h3>Internal Changes</h3>
<ul>
<li>Reformat SDK with YAPF 0.43. (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/822">#822</a>).</li>
<li>Update Jobs GetRun API to support paginated responses for jobs and
ForEach tasks (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/819">#819</a>).</li>
</ul>
<h3>API Changes:</h3>
<ul>
<li>Added <code>service_principal_client_id</code> field for
<code>databricks.sdk.service.apps.App</code>.</li>
<li>Added <code>azure_service_principal</code>,
<code>gcp_service_account_key</code> and <code>read_only</code> fields
for
<code>databricks.sdk.service.catalog.CreateCredentialRequest</code>.</li>
<li>Added <code>azure_service_principal</code>, <code>read_only</code>
and <code>used_for_managed_storage</code> fields for
<code>databricks.sdk.service.catalog.CredentialInfo</code>.</li>
<li>Added <code>omit_username</code> field for
<code>databricks.sdk.service.catalog.ListTablesRequest</code>.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/672da6f1323b803ec069c55e5d952163d1b397fe"><code>672da6f</code></a>
[Release] Release v0.39.0 (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/836">#836</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/b23571730435ba95afb0e3a8593419b9140664b9"><code>b235717</code></a>
[Internal] Update SDK to OpenAPI spec (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/834">#834</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/980166030c688e08a52d0f55389abd766f1d928d"><code>9801660</code></a>
[Fix] Update Changelog file (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/830">#830</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-py/commit/74f9a4f22991ba459f1d4bafe95cd602a3cd9530"><code>74f9a4f</code></a>
[Internal] Fix a couple of typos in open_ai_client.py (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/issues/829">#829</a>)</li>
<li>See full diff in <a
href="https://github.com/databricks/databricks-sdk-py/compare/v0.38.0...v0.39.0">compare
view</a></li>
</ul>
</details>
<br />

<details>
<summary>Most Recent Ignore Conditions Applied to This Pull
Request</summary>

| Dependency Name | Ignore Conditions |
| --- | --- |
| databricks-sdk | [>= 0.25.a, < 0.26] |
</details>


Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Author: JCZuurmond

pyproject.toml

@@ -44,7 +44,7 @@ classifiers = [
     "Topic :: Utilities",
 ]
 
-dependencies = ["databricks-sdk>=0.39",
+dependencies = ["databricks-sdk>=0.39,<0.40",
                 "databricks-labs-lsql>=0.14.0,<0.15",
                 "databricks-labs-blueprint>=0.9.1,<0.10",
                 "PyYAML>=6.0.0,<7.0.0",