pipelines run: enrich output of pipelines by alyssa-db · Pull Request #3332 · databricks/cli

alyssa-db · 2025-07-31T07:00:17Z

Changes

On run, the corresponding run's update information is displayed.

Why

enrich run information.

Tests

doc can be found here.

Sample output:
Update ID: dc390a6b-71e0-4274-8382-49472ac85632
Update for pipeline [dev alyssa_gorbaneva] hi_pipeline completed successfully.
Pipeline ID: ef8b547f-1e96-43c4-b50a-4c1c3a74e491
Update start time: 2025-08-06T23:00:19Z
Update end time: 2025-08-06T23:01:40Z.
Pipeline configurations for this update:
• All tables are refreshed
• Update cause: API_CALL
• Serverless compute
• Channel: CURRENT
• Development mode
• Catalog: main
• Schema: alyssa_gorbaneva

Follows #3331

Follow up: #3337

eng-dev-ecosystem-bot · 2025-07-31T07:12:32Z

Run: 16790719443

	Env	✅‌pass	🔄‌flaky	🙈‌skip
✅‌	aws linux	309		462
✅‌	aws windows	310		461
🔄‌	aws-ucws linux	405	10	362
🔄‌	aws-ucws windows	406	10	361
✅‌	azure linux	309		461
✅‌	azure windows	310		460
🔄‌	azure-ucws linux	408	9	359
🔄‌	azure-ucws windows	410	8	358
✅‌	gcp linux	308		463
✅‌	gcp windows	309		462

10 failing tests:

Test Name	aws-ucws linux	aws-ucws windows	azure-ucws linux	azure-ucws windows
TestAccept/bundle/deploy/dashboard/detect-change	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deploy/dashboard/generate_inplace	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deploy/dashboard/nested-folders	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple_outside_bundle_root	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple_syncroot	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestAccept/bundle/deployment/bind/dashboard	🔄‌flaky	🔄‌flaky	🔄‌flaky	✅‌pass
TestAccept/bundle/deployment/bind/dashboard/recreation	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestDashboardAssumptions_WorkspaceImport	🔄‌flaky	🔄‌flaky	🔄‌flaky	🔄‌flaky
TestFetchRepositoryInfoAPI_FromRepo	🔄‌flaky	🔄‌flaky	✅‌pass	✅‌pass

## Changes To see which update was run, return updateID in the output. ## Why Necessary for showing summary of run in pipelines. ## Tests Updated bundle and pipelines tests to reflect new output. Sample output: Update ID: 2e522dc5-f817-46dc-b956-2e3e771d9ff3 update ID necessary for follow-up: #3332

cmd/pipelines/output/updates.go

cmd/pipelines/run.go

cmd/pipelines/run_test.go

cmd/pipelines/templates.go

cmd/pipelines/run.go

cmd/pipelines/templates.go

jefferycheng1 · 2025-08-06T22:32:00Z

cmd/pipelines/run_test.go

+			assert.Equal(t, tt.expected, buf.String())
+		})
+	}
+}


as a follow-up, we should think about the behavior where certain fields are missing. It's actually a little weird that we just display as normal, when there are certain fields that we expect to exist to not be present, and that we just silently omit them.

Also some edge cases here:

custom image instead of channel

cmd/pipelines/templates.go

jefferycheng1

template small nits, make sure to fix before merging.

## Changes On run, the corresponding run's update information is displayed. ## Why enrich run information. ## Tests doc can be found [here](https://docs.google.com/document/d/1JUpKLpQM1GP6NV7QtJmtEzU4IDXhl8GxrCNA9n_hvMs/edit?tab=t.0#heading=h.xeb4b9r7dqoi). Sample output: Update ID: dc390a6b-71e0-4274-8382-49472ac85632 Update for pipeline [dev alyssa_gorbaneva] hi_pipeline completed successfully. Pipeline ID: ef8b547f-1e96-43c4-b50a-4c1c3a74e491 Update start time: 2025-08-06T23:00:19Z Update end time: 2025-08-06T23:01:40Z. Pipeline configurations for this update: • All tables are refreshed • Update cause: API_CALL • Serverless compute • Channel: CURRENT • Development mode • Catalog: main • Schema: alyssa_gorbaneva Follows #3331 Follow up: #3337

## Changes Acceptance tests, following #3337 and #3332 Test output of `pipelines run` based on test.toml API endpoints

alyssa-db temporarily deployed to test-trigger-is July 31, 2025 07:00 — with GitHub Actions Inactive

alyssa-db mentioned this pull request Jul 31, 2025

bundle run: output update ID #3331

Merged

alyssa-db temporarily deployed to test-trigger-is August 1, 2025 03:41 — with GitHub Actions Inactive

alyssa-db force-pushed the run-events-1 branch from 79c6724 to ebb295c Compare August 1, 2025 04:13

alyssa-db temporarily deployed to test-trigger-is August 1, 2025 04:13 — with GitHub Actions Inactive

alyssa-db temporarily deployed to test-trigger-is August 1, 2025 05:42 — with GitHub Actions Inactive

alyssa-db marked this pull request as ready for review August 1, 2025 05:45

alyssa-db requested review from andrewnester, anton-107, denik, jefferycheng1, kanterov, lennartkats-db, pietern and shreyas-goenka as code owners August 1, 2025 05:45

alyssa-db temporarily deployed to test-trigger-is August 1, 2025 05:50 — with GitHub Actions Inactive

Base automatically changed from run-events-0 to main August 1, 2025 06:44

jefferycheng1 reviewed Aug 1, 2025

View reviewed changes

cmd/pipelines/output/updates.go Outdated Show resolved Hide resolved

alyssa-db temporarily deployed to test-trigger-is August 1, 2025 18:52 — with GitHub Actions Inactive

alyssa-db force-pushed the run-events-1 branch 2 times, most recently from 76b77bd to a44303f Compare August 1, 2025 22:21

alyssa-db requested a review from jefferycheng1 August 2, 2025 00:14

alyssa-db force-pushed the run-events-1 branch from ee0f991 to 172a48c Compare August 2, 2025 00:17

alyssa-db temporarily deployed to test-trigger-is August 2, 2025 00:20 — with GitHub Actions Inactive

alyssa-db added 4 commits August 1, 2025 17:21

rebase

83bd23c

working default case

934746d

success template

688838d

success template

151c49e

comment function docs

6c4a47f

alyssa-db temporarily deployed to test-trigger-is August 5, 2025 18:27 — with GitHub Actions Inactive

alyssa-db requested a review from jefferycheng1 August 5, 2025 18:29

alyssa-db commented Aug 5, 2025

View reviewed changes

cmd/pipelines/run.go Show resolved Hide resolved

jefferycheng1 reviewed Aug 6, 2025

View reviewed changes

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 15:31 — with GitHub Actions Inactive

template updates

760a2a4

alyssa-db force-pushed the run-events-1 branch from 8514c2f to 760a2a4 Compare August 6, 2025 19:10

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 19:10 — with GitHub Actions Inactive

acc tests

54a449f

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 19:11 — with GitHub Actions Inactive

Merge branch 'main' into run-events-1

7f41952

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 19:12 — with GitHub Actions Inactive

alyssa-db requested a review from jefferycheng1 August 6, 2025 19:28

added comment specifying order

be1fdd5

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 19:28 — with GitHub Actions Inactive

jefferycheng1 reviewed Aug 6, 2025

View reviewed changes

cmd/pipelines/templates.go Outdated Show resolved Hide resolved

jefferycheng1 reviewed Aug 6, 2025

View reviewed changes

cmd/pipelines/templates.go Outdated Show resolved Hide resolved

jefferycheng1 approved these changes Aug 6, 2025

View reviewed changes

new template

de19e9f

alyssa-db temporarily deployed to test-trigger-is August 6, 2025 23:05 — with GitHub Actions Inactive

alyssa-db enabled auto-merge August 6, 2025 23:05

alyssa-db added this pull request to the merge queue Aug 6, 2025

Merged via the queue into main with commit 513d3de Aug 6, 2025
13 checks passed

alyssa-db deleted the run-events-1 branch August 6, 2025 23:42

alyssa-db restored the run-events-1 branch August 6, 2025 23:49

github-merge-queue bot pushed a commit that referenced this pull request Aug 15, 2025

acc: pipelines run enrich events output (#3355)

146dce6

## Changes Acceptance tests, following #3337 and #3332 Test output of `pipelines run` based on test.toml API endpoints

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

pipelines run: enrich output of pipelines#3332

pipelines run: enrich output of pipelines#3332
alyssa-db merged 23 commits intomainfrom
run-events-1

alyssa-db commented Jul 31, 2025 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Jul 31, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jefferycheng1 Aug 6, 2025

Uh oh!

Uh oh!

jefferycheng1 left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Comments

Conversation

alyssa-db commented Jul 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Jul 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jefferycheng1 Aug 6, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

jefferycheng1 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

alyssa-db commented Jul 31, 2025 •

edited

Loading

eng-dev-ecosystem-bot commented Jul 31, 2025 •

edited

Loading