Skip to content

Conversation

@lennartkats-db
Copy link
Contributor

Changes

This updates templates to serverless environment version 4 and associated Python versions

Some considerations:

  • Client version 4, client version 5 (upcoming), DBR 16, DBR 17 all use Python 3.12
  • DB Connect 15 supports all DBR versions above and supports Python 3.12
  • DB Connect 15 also supports DBR 15, which uses Python 3.11 at runtime, but that discrepancy already exists and seems okay
  • Pinning Python to a very narrow range in pyproject.toml means users always need to use uv to install the right version, which may not be great for usability. so I haven't change that approach either

Why

  • Environment version 4 provides better startup performance and new features

Tests

  • Standard acceptance testing

lennartkats-db and others added 4 commits November 7, 2025 08:58
Remove the Python version spec changes from experimental-jobs-as-code template
to minimize the diff. This template doesn't need the same Python version
constraints as the default template.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Nov 10, 2025

Run: 19234693264

Env 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip
💚​ aws linux 1 1 356 601
💚​ aws windows 1 1 357 600
💚​ aws-ucws linux 1 1 491 492
💚​ aws-ucws windows 1 1 492 491
💚​ azure linux 1 1 356 600
💚​ azure windows 1 1 357 599
💚​ azure-ucws linux 1 1 487 491
💚​ azure-ucws windows 1 1 488 490
🔄​ gcp linux 6 1 1 349 602
🔄​ gcp windows 4 1 1 352 601
12 failing tests:
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
TestAccept/bundle/local_state_staleness ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/local_state_staleness/DATABRICKS_BUNDLE_ENGINE=terraform ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/resources/clusters/deploy/simple ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/resources/clusters/deploy/simple/DATABRICKS_BUNDLE_ENGINE=direct ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/resources/jobs/fail-on-active-runs ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/resources/jobs/fail-on-active-runs/DATABRICKS_BUNDLE_ENGINE=direct ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/resources/pipelines/auto-approve ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestAccept/bundle/resources/pipelines/auto-approve/DATABRICKS_BUNDLE_ENGINE=terraform ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestAccept/bundle/run/app-with-job 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=yes ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f

* This needs to be compatible with the version of DB Connect and the serverless_environment_version.
*/}}
{{define "python_version_spec" -}}
>=3.10,<3.13
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As this is the only spot where the local Python version is specified, could you copy the rationale from the PR summary here? I was wondering when seeing this line before reading the PR summary.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, good feedback.

Expands the python_version_spec comment to explain why we use >=3.10,<3.13
rather than pinning to 3.12. The broader range improves usability by avoiding
the need for version managers while maintaining compatibility with DB Connect
15, serverless environment v4/v5, and DBR 16/17.

Addresses PR feedback: #3897 (review)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants