Skip to content

Element Web End to End Tests #6223

Element Web End to End Tests

Element Web End to End Tests #6223

Triggered via merge group September 2, 2026 09:32
Status Failure
Total duration 29m 41s
Artifacts 7
Playwright  /  Build Element Web
2m 14s
Playwright / Build Element Web
Playwright  /  ...  /  Prepare
Playwright / Prepare Element Desktop / Prepare
Matrix: Playwright / playwright_ew
Playwright  /  Modules Playwright tests
5m 4s
Playwright / Modules Playwright tests
Matrix: Playwright / Desktop Linux
Waiting for pending jobs
Matrix: Playwright / Desktop Windows
Waiting for pending jobs
Playwright  /  ...  /  Build macOS Universal
Playwright / Desktop macOS / Build macOS Universal
Playwright  /  ...  /  test
Playwright / Desktop macOS / Test macOS Universal / test
Playwright  /  end-to-end-tests
52s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

8 errors and 5 notices
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot: apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L108
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.fill: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).getByRole('spinbutton', { name: '@user_6496a26110e4309860ce-e6b187015ed0865317ce:localhost' }) 106 | await ourComboBox.selectOption("Custom level"); 107 | const ourPl = settings.getByRole("spinbutton", { name: user.userId }); > 108 | await ourPl.fill("50"); | ^ 109 | await page.keyboard.press("Tab"); // Shows a warning on 110 | 111 | // Accept the de-op at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts:108:25
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot: apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L0
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot: apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L112
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('button', { name: 'Continue' }) 110 | 111 | // Accept the de-op > 112 | await page.getByRole("button", { name: "Continue" }).click(); | ^ 113 | await settings.getByRole("button", { name: "Apply", disabled: false }).click(); 114 | 115 | // Close and await power level at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts:112:66
Playwright / Run Tests [Chrome] 4/4
Process completed with exit code 1.
[Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot: packages/playwright-common/lib/expect/screenshot.js#L38
3) [Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']') 241 pixels (ratio 0.01 of all image pixels) are different. Snapshot: event-tile-permalink-selected.png Call log: - Expect "toHaveScreenshot(event-tile-permalink-selected.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']') - locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" data-scroll-tokens="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 241 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']') - locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" data-scroll-tokens="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 241 pixels (ratio 0.01 of all image pixels) are different. at ../../../../packages/playwright-common/lib/expect/screenshot.js:38 36 | } 37 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 38 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 39 | await style?.evaluate((tag) => tag.remove()); 40 | testInfo.annotations.push({ 41 | type: ANNOTATION, at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/packages/playwright-common/lib/expect/screenshot.js:38:32) at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/element-web-test.ts:183:9) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/timeline/event-tile-view.spec.ts:134:13
[Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot: packages/playwright-common/lib/expect/screenshot.js#L38
3) [Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) failed Locator: locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']') 241 pixels (ratio 0.01 of all image pixels) are different. Snapshot: event-tile-permalink-selected.png Call log: - Expect "toHaveScreenshot(event-tile-permalink-selected.png)" with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']') - locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" data-scroll-tokens="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 241 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']') - locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" data-scroll-tokens="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 241 pixels (ratio 0.01 of all image pixels) are different. at ../../../../packages/playwright-common/lib/expect/screenshot.js:38 36 | } 37 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 38 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 39 | await style?.evaluate((tag) => tag.remove()); 40 | testInfo.annotations.push({ 41 | type: ANNOTATION, at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/packages/playwright-common/lib/expect/screenshot.js:38:32) at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/element-web-test.ts:183:9) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/timeline/event-tile-view.spec.ts:134:13
Playwright / end-to-end-tests
Process completed with exit code 1.
Playwright / end-to-end-tests
1 tests failed, skipping stale screenshot reporter.
🎭 Playwright Run Summary
31 passed (2.9m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:192:13 › Room list › Room list › Shortcuts › should select the next unread room 33 skipped 148 passed (17.0m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot 14 skipped 175 passed (18.2m)
🎭 Playwright Run Summary
1 failed [Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot 4 flaky [Chrome] › playwright/e2e/spotlight/spotlight.spec.ts:417:13 › Spotlight › light theme legibility › should have legible text across Spotlight surfaces [Chrome] › playwright/e2e/spotlight/spotlight.spec.ts:417:13 › Spotlight › dark theme legibility › should have legible text across Spotlight surfaces [Chrome] › playwright/e2e/timeline/timeline.spec.ts:358:9 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:581:9 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot 2 skipped 182 passed (20.1m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:194:5 › Audio player › should be correctly rendered - light theme with monospace font @no-firefox @no-webkit @screenshot 200 passed (17.9m)

Artifacts

Produced during runtime
Name Size Digest
blob-report-Chrome-1 Expired
6.13 MB
sha256:b6314fa8c5a92490679c235dfb0cc451f95bd51245c43f46969edbd47e867ef0
blob-report-Chrome-2 Expired
8.83 MB
sha256:b5db169659a57b567e3c3d0f4f572aefcf795a996ad9d4d113ab7ea63f7b16ce
blob-report-Chrome-3 Expired
7.4 MB
sha256:83842ab870c6783254806aafd31455bfaaf115e3ed09841401816f9e69b8a5d9
blob-report-Chrome-4 Expired
30.2 MB
sha256:161141d532c04892530373e172af3b09f5ceec71f6a27e0bb65325af7e66e6d7
blob-report-modules Expired
219 KB
sha256:18a4d5481ca8ab73ca6cd35ca3511d9405b986888c3ec12b70095c143fe2bca4
html-report
49.3 MB
sha256:912ae677f67c4012eb2fadce42bf424f23ae2dc7df04ff55427b9d767b5d8f2a
webapp Expired
41.2 MB
sha256:f79ca68c77cc433131aca383cf566b1d1429570613033ac9b0b44388c0b70625