Gracefully exit when terminated mid deploy / destroy

[shreyas-goenka]

Changes

Adds graceful signal handling (SIGINT, SIGTERM, SIGHUP, SIGQUIT) during bundle deployment and destruction. When interrupted, the CLI waits for the current operation to complete, releases the deployment lock, and exits with the appropriate exit code.

Makes lock release idempotent to handle race conditions when multiple cleanup paths attempt to release the lock.

Tests

• Added acceptance test for signal during lock release
• Added unit tests for lock release and unlock idempotency

[eng-dev-ecosystem-bot]

Run: 19141414460

	Env	🪲​BUG	❌​FAIL	🟨​KNOWN	🔄​flaky	💚​RECOVERED	🙈​SKIP	✅​pass	🙈​skip
🪲​	aws linux	2			7	1	1	347	596
🪲​	aws windows	2			2	1	1	353	595
🪲​	aws-ucws linux	2				1	1	477	491
🪲​	aws-ucws windows	2				1	1	478	490
🪲​	azure linux	2			4	1	1	350	595
🪲​	azure windows	2				1	1	355	594
🪲​	azure-ucws linux	2				1	1	473	490
🪲​	azure-ucws windows	2				1	1	474	489
🪲​	gcp linux	2	21	1			1	332	597
🪲​	gcp windows	2	26	1			1	328	596

49 failing tests:

Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
TestAccept	💚​R	💚​R	💚​R	💚​R	💚​R	💚​R	💚​R	💚​R	🟨​K	🟨​K
TestAccept/bundle/deploy/files/no-snapshot-sync	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/destroy/jobs-and-pipeline/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/destroy/jobs-and-pipeline/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/local_state_staleness	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/local_state_staleness/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/resources/clusters/deploy/data_security_mode	✅​p	✅​p	✅​p	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/resources/experiments/basic	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/experiments/basic/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/allow-duplicate-names	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/allow-duplicate-names/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/auto-approve	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/auto-approve/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/auto-approve/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/lakeflow-pipeline	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/resources/pipelines/lakeflow-pipeline/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/resources/pipelines/lakeflow-pipeline/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/resources/pipelines/update	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/resources/pipelines/update/DATABRICKS_BUNDLE_ENGINE=direct	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/resources/pipelines/update/DATABRICKS_BUNDLE_ENGINE=terraform	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/run/app-with-job	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S	🙈​S
TestAccept/bundle/templates/default-python/combinations/classic	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=yes	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=no	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=no	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=no	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=yes	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=yes	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=no	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=no	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=no	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=yes	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/integration_classic	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	❌​F
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=direct/UV_PYTHON=3.10	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=direct/UV_PYTHON=3.11	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=direct/UV_PYTHON=3.12	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.10	🔄​f	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.11	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestImportDir	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	✅​p	❌​F	✅​p
TestLock	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B
TestLockUnlockWithoutAllowsLockFileNotExist	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B	🪲​B

[shreyas-goenka]

We don't need goal anymore since lock.Release is idempotent.

[github-actions]

This PR has not received an update in a while. If you want to keep this PR open, please leave a comment below or push a new commit and auto-close will be canceled.