[ux] migrate synthetics journeys to scout by dmlemeshko · Pull Request #253366 · elastic/kibana

dmlemeshko · 2026-02-17T00:16:04Z

Closes https://github.com/elastic/appex-qa-team/issues/716

Summary

This PR migrates all running @elastic/synthetics journeys in the ux plugin into Scout test specs.
Since Scout tests are always run, the opt-in pipeline step has been removed.

Journeys migrated

Original journey	Scout spec
`core_web_vitals.ts`	`core_web_vitals.spec.ts`
`inp.journey.ts`	`inp.spec.ts`
`page_views.ts`	`page_views.spec.ts`
`url_ux_query.journey.ts`	`ux_url_query.spec.ts`
`ux_client_metrics.journey.ts`	`ux_client_metrics.spec.ts`
`ux_js_errors.journey.ts`	`ux_js_errors.spec.ts`
`ux_long_task_metric_journey.ts`	`ux_long_task_metrics.spec.ts`
`ux_visitor_breakdown.journey.ts`	`ux_visitor_breakdown.spec.ts`

Re-enabled (was commented out in original index.ts): page_views.ts

New Scout directory structure

x/test/scout/ui/
├── playwright.config.ts
├── fixtures/
│   ├── index.ts                  (extends ObltTestFixtures with UX page objects)
│   ├── constants.ts              (ES archive paths, default query params)
│   └── page_objects/
│       ├── index.ts
│       └── ux_dashboard.ts       (navigation, loading waits, chart locators)
└── tests/
    ├── global.setup.ts           (loads ES archives + INP test data)
    └── *.spec.ts                 (8 test specs)

ES archive fixtures remain at ux/e2e/fixtures/ (rum_8.0.0, rum_test_data).

Key fixes during migration

Updated Core Web Vitals labels: replaced deprecated "First input delay" with "Interaction to next paint" (INP replaced FID)
Fixed brittle selectors: replaced text-concatenation locators with data-test-subj selectors (e.g., pvBreakdownFilter for breakdown dropdown)
Fixed lazy-loaded sections: LoadWhenInView components (JS Errors, Visitor Breakdown) require scrolling the placeholder into the viewport to trigger the intersection observer
Fixed ambiguous text matching: used { exact: true } for browser legend labels that match multiple elements (e.g., "Chrome" vs "Chrome Mobile")
Removed buggy date picker override: original journeys set date range via URL params (2020–2021) then overrode to 2022 via date picker — fixture data only exists in 2020–2021, so the override was a latent bug
Guarded INP data against duplicates: added idempotency check before indexing INP test transactions

CI changes

Added ux to .buildkite/scout_ci_config.yml
Removed ux_plugin_e2e.yml pipeline and ux_synthetics_e2e.sh script
Removed ux/.buildkite/ flaky test pipeline
Cleaned up ftr_oblt_stateful_configs.yml

Made with Cursor

dmlemeshko · 2026-02-21T10:06:43Z

/flaky scoutConfig:x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts:30

kibanamachine · 2026-02-21T10:06:56Z

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10816

x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts x30

kibanamachine · 2026-02-21T10:49:17Z

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10816

[✅] x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts: 30/30 tests passed.

see run history

elasticmachine · 2026-02-23T16:53:55Z

Pinging @elastic/obs-presentation-team (Team:obs-presentation)

elasticmachine · 2026-02-23T16:53:55Z

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/global.setup.ts

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/ux_visitor_breakdown.spec.ts

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/page_views.spec.ts

x-pack/solutions/observability/plugins/ux/test/scout/ui/fixtures/page_objects/ux_dashboard.ts

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/page_views.spec.ts

kibanamachine · 2026-02-26T14:08:35Z

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10867

x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts x30

.buildkite/scripts/pipelines/pull_request/pipeline.ts

miguelmartin-elastic

LGTM, thanks for addressing the comments 🚀

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/inp.spec.ts

csr

Recent changes LGTM

kibanamachine · 2026-02-26T14:51:30Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10867

[❌] x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts: 21/30 tests passed.

see run history

dmlemeshko · 2026-02-26T16:22:15Z

/flaky scoutConfig:x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts:25

kibanamachine · 2026-02-26T16:22:32Z

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10871

x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts x25

kibanamachine · 2026-02-26T17:01:13Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10871

[❌] x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts: 18/25 tests passed.

see run history

dmlemeshko · 2026-02-26T17:24:49Z

/flaky scoutConfig:x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts:30

kibanamachine · 2026-02-26T17:25:05Z

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10873

x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts x30

kibanamachine · 2026-02-26T18:12:09Z

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10873

[✅] x-pack/solutions/observability/plugins/ux/test/scout/ui/playwright.config.ts: 30/30 tests passed.

see run history

elasticmachine · 2026-02-26T18:37:37Z

💔 Build Failed

Buildkite Build
Commit: 28633a2

Failed CI Steps

Post-Build

Metrics [docs]

‼️ ERROR: no builds found for mergeBase sha [3c7ef04]

History

💔 Build #401551 failed 66d017a
💔 Build #399834 failed 63ba157
💚 Build #398819 succeeded 86f3c3e
💔 Build #397166 failed 4fffddd
💔 Build #397089 failed 6dd6b43

smith

Scout migration looks good. LGTM.

kibanamachine · 2026-02-26T22:29:48Z

Starting backport for target branches: 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/22463974237

Closes elastic/appex-qa-team#716 ## Summary This PR migrates all running `@elastic/synthetics` journeys in the ux plugin into Scout test specs. Since Scout tests are always run, the opt-in pipeline step has been removed. ### Journeys migrated | Original journey | Scout spec | |---|---| | `core_web_vitals.ts` | `core_web_vitals.spec.ts ` | | `inp.journey.ts` | `inp.spec.ts` | | `page_views.ts` | `page_views.spec.ts` | | `url_ux_query.journey.ts` | `ux_url_query.spec.ts` | | `ux_client_metrics.journey.ts` | `ux_client_metrics.spec.ts` | | `ux_js_errors.journey.ts` | `ux_js_errors.spec.ts` | | `ux_long_task_metric_journey.ts` | `ux_long_task_metrics.spec.ts` | | `ux_visitor_breakdown.journey.ts` | `ux_visitor_breakdown.spec.ts` | Re-enabled (was commented out in original index.ts): page_views.ts ### New Scout directory structure ``` x/test/scout/ui/ ├── playwright.config.ts ├── fixtures/ │ ├── index.ts (extends ObltTestFixtures with UX page objects) │ ├── constants.ts (ES archive paths, default query params) │ └── page_objects/ │ ├── index.ts │ └── ux_dashboard.ts (navigation, loading waits, chart locators) └── tests/ ├── global.setup.ts (loads ES archives + INP test data) └── *.spec.ts (8 test specs) ``` ES archive fixtures remain at `ux/e2e/fixtures/` (rum_8.0.0, rum_test_data). ### Key fixes during migration - Updated Core Web Vitals labels: replaced deprecated `"First input delay"` with `"Interaction to next paint"` (INP replaced FID) - Fixed brittle selectors: replaced text-concatenation locators with `data-test-subj` selectors (e.g., `pvBreakdownFilter` for breakdown dropdown) - Fixed lazy-loaded sections: `LoadWhenInView` components (JS Errors, Visitor Breakdown) require scrolling the placeholder into the viewport to trigger the intersection observer - Fixed ambiguous text matching: used `{ exact: true }` for browser legend labels that match multiple elements (e.g., `"Chrome"` vs `"Chrome Mobile"`) - Removed buggy date picker override: original journeys set date range via URL params (2020–2021) then overrode to 2022 via date picker — fixture data only exists in 2020–2021, so the override was a latent bug - Guarded INP data against duplicates: added idempotency check before indexing INP test transactions ### CI changes - Added ux to `.buildkite/scout_ci_config.yml` - Removed `ux_plugin_e2e.yml` pipeline and `ux_synthetics_e2e.sh` script - Removed `ux/.buildkite/` flaky test pipeline - Cleaned up `ftr_oblt_stateful_configs.yml` Made with [Cursor](https://cursor.com) --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> (cherry picked from commit 45aebb3)

kibanamachine · 2026-02-26T22:38:31Z

💔 Some backports could not be created

Status	Branch	Result
❌	9.2	Backport failed because of merge conflicts
✅	9.3

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 253366

Questions ?

Please refer to the Backport tool documentation

dmlemeshko and others added 12 commits February 17, 2026 01:15

[ux] migrate synthetics journeys to scout

bd57a92

Changes from node scripts/lint_ts_projects --fix

1633445

Changes from node scripts/regenerate_moon_projects.js --update

ef09ab9

restore helpers

7167821

Merge branch 'main' into migrate-ux-journeys-to-scout

0e234fe

Merge branch 'main' into migrate-ux-journeys-to-scout

6dd6b43

Changes from node scripts/lint_ts_projects --fix

a46994e

Changes from node scripts/regenerate_moon_projects.js --update

bd9cc2d

Merge branch 'main' into migrate-ux-journeys-to-scout

4fffddd

Merge branch 'main' into migrate-ux-journeys-to-scout

32f00af

update tests

de8b916

Update ftr_oblt_stateful_configs.yml

86f3c3e

dmlemeshko added backport:version Backport to applied version labels v9.3.1 v9.2.6 release_note:skip Skip the PR/issue when compiling release notes labels Feb 21, 2026

dmlemeshko marked this pull request as ready for review February 23, 2026 09:32

dmlemeshko requested review from a team as code owners February 23, 2026 09:32

jbudz approved these changes Feb 23, 2026

View reviewed changes

botelastic bot added Team:obs-presentation Focus: APM UI, Infra UI, Hosts UI, Universal Profiling, Obs Overview and left Navigation Team:obs-ux-management labels Feb 23, 2026

Merge branch 'main' into migrate-ux-journeys-to-scout

63ba157

miguelmartin-elastic reviewed Feb 25, 2026

View reviewed changes

csr reviewed Feb 26, 2026

View reviewed changes

.buildkite/scripts/pipelines/pull_request/pipeline.ts Show resolved Hide resolved

miguelmartin-elastic approved these changes Feb 26, 2026

View reviewed changes

csr reviewed Feb 26, 2026

View reviewed changes

x-pack/solutions/observability/plugins/ux/test/scout/ui/tests/inp.spec.ts Show resolved Hide resolved

dmlemeshko added 2 commits February 26, 2026 15:32

Delete .buildkite/pipelines/pull_request/ux_plugin_e2e.yml

c77c19e

Merge branch 'main' into migrate-ux-journeys-to-scout

66d017a

csr approved these changes Feb 26, 2026

View reviewed changes

dmlemeshko enabled auto-merge (squash) February 26, 2026 14:46

dmlemeshko disabled auto-merge February 26, 2026 14:48

fix flaky test

be32c9f

dmlemeshko requested a review from a team as a code owner February 26, 2026 16:21

Merge branch 'main' into migrate-ux-journeys-to-scout

edbf32b

skip flaky step

28633a2

dmlemeshko enabled auto-merge (squash) February 26, 2026 18:09

smith approved these changes Feb 26, 2026

View reviewed changes

Merge branch 'main' into migrate-ux-journeys-to-scout

370b2bb

dmlemeshko merged commit 45aebb3 into elastic:main Feb 26, 2026
16 checks passed

kibanamachine added the v9.4.0 label Feb 26, 2026

kibanamachine mentioned this pull request Feb 26, 2026

[9.3] [ux] migrate synthetics journeys to scout (#253366) #255207

Open

Conversation

dmlemeshko commented Feb 17, 2026 • edited by kibanamachine Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Journeys migrated

New Scout directory structure

Key fixes during migration

CI changes

Uh oh!

dmlemeshko commented Feb 21, 2026

Uh oh!

kibanamachine commented Feb 21, 2026

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10816

Uh oh!

kibanamachine commented Feb 21, 2026

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10816

Uh oh!

elasticmachine commented Feb 23, 2026

Uh oh!

elasticmachine commented Feb 23, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10867

Uh oh!

Uh oh!

miguelmartin-elastic left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

csr left a comment

Choose a reason for hiding this comment

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10867

Uh oh!

dmlemeshko commented Feb 26, 2026

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10871

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10871

Uh oh!

dmlemeshko commented Feb 26, 2026

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner

✅ Build triggered - kibana-flaky-test-suite-runner#10873

Uh oh!

kibanamachine commented Feb 26, 2026

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10873

Uh oh!

elasticmachine commented Feb 26, 2026

💔 Build Failed

Failed CI Steps

Metrics [docs]

History

Uh oh!

smith left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kibanamachine commented Feb 26, 2026

Uh oh!

kibanamachine commented Feb 26, 2026

💔 Some backports could not be created

Manual backport

Questions ?

dmlemeshko commented Feb 17, 2026 •

edited by kibanamachine

Loading