Element Web End to End Tests #6223
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element Web
2m 14s
Matrix: Playwright / playwright_ew
Matrix: Playwright / Desktop Linux
Waiting for pending jobs
Matrix: Playwright / Desktop Windows
Waiting for pending jobs
Playwright
/
end-to-end-tests
52s
Annotations
8 errors and 5 notices
|
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot:
apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L108
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).getByRole('spinbutton', { name: '@user_6496a26110e4309860ce-e6b187015ed0865317ce:localhost' })
106 | await ourComboBox.selectOption("Custom level");
107 | const ourPl = settings.getByRole("spinbutton", { name: user.userId });
> 108 | await ourPl.fill("50");
| ^
109 | await page.keyboard.press("Tab"); // Shows a warning on
110 |
111 | // Accept the de-op
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts:108:25
|
|
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot:
apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L0
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot:
apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts#L112
1) [Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('button', { name: 'Continue' })
110 |
111 | // Accept the de-op
> 112 | await page.getByRole("button", { name: "Continue" }).click();
| ^
113 | await settings.getByRole("button", { name: "Apply", disabled: false }).click();
114 |
115 | // Close and await power level
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/settings/room-settings/room-security-tab.spec.ts:112:66
|
|
Playwright / Run Tests [Chrome] 4/4
Process completed with exit code 1.
|
|
[Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot:
packages/playwright-common/lib/expect/screenshot.js#L38
3) [Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']')
241 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-permalink-selected.png
Call log:
- Expect "toHaveScreenshot(event-tile-permalink-selected.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']')
- locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" data-scroll-tokens="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 241 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile[data-event-id=\'$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk\']')
- locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" data-scroll-tokens="$2RHSvwwpfPz1Y1uWDZpU9GoCmxKdNTMGpPUMDXiW4Pk" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 241 pixels (ratio 0.01 of all image pixels) are different.
at ../../../../packages/playwright-common/lib/expect/screenshot.js:38
36 | }
37 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 38 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
39 | await style?.evaluate((tag) => tag.remove());
40 | testInfo.annotations.push({
41 | type: ANNOTATION,
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/packages/playwright-common/lib/expect/screenshot.js:38:32)
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/element-web-test.ts:183:9)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/timeline/event-tile-view.spec.ts:134:13
|
|
[Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot:
packages/playwright-common/lib/expect/screenshot.js#L38
3) [Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected) failed
Locator: locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']')
241 pixels (ratio 0.01 of all image pixels) are different.
Snapshot: event-tile-permalink-selected.png
Call log:
- Expect "toHaveScreenshot(event-tile-permalink-selected.png)" with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']')
- locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" data-scroll-tokens="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 241 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile[data-event-id=\'$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU\']')
- locator resolved to <li tabindex="-1" aria-live="off" aria-atomic="true" data-testid="event-tile" data-event-id="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" data-scroll-tokens="$iHJ5Va8KQ01rGqFbPKhLyvtmdCMl0B7SYdqcNt-DOdU" class="_root_18x1m_9 mx_EventTile _stateOwnEvent_18x1m_903 _hasReceiptSlot_18x1m_320 _stateSelected_18x1m_308 _stateLastInSection_18x1m_990 _layoutGroup_18x1m_194">…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 241 pixels (ratio 0.01 of all image pixels) are different.
at ../../../../packages/playwright-common/lib/expect/screenshot.js:38
36 | }
37 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 38 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
39 | await style?.evaluate((tag) => tag.remove());
40 | testInfo.annotations.push({
41 | type: ANNOTATION,
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/packages/playwright-common/lib/expect/screenshot.js:38:32)
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/element-web-test.ts:183:9)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/apps/web/playwright/e2e/timeline/event-tile-view.spec.ts:134:13
|
|
Playwright / end-to-end-tests
Process completed with exit code 1.
|
|
Playwright / end-to-end-tests
1 tests failed, skipping stale screenshot reporter.
|
|
🎭 Playwright Run Summary
31 passed (2.9m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/left-panel/room-list-panel/room-list.spec.ts:192:13 › Room list › Room list › Shortcuts › should select the next unread room
33 skipped
148 passed (17.0m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/settings/room-settings/room-security-tab.spec.ts:87:5 › Roles & Permissions room settings tab › should disallow changing from public to private if the user cannot alter history @screenshot
14 skipped
175 passed (18.2m)
|
|
🎭 Playwright Run Summary
1 failed
[Chrome] › playwright/e2e/timeline/event-tile-view.spec.ts:64:5 › EventTileView application coverage › keeps tile interaction states in the application DOM @screenshot
4 flaky
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts:417:13 › Spotlight › light theme legibility › should have legible text across Spotlight surfaces
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts:417:13 › Spotlight › dark theme legibility › should have legible text across Spotlight surfaces
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:358:9 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:581:9 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot
2 skipped
182 passed (20.1m)
|
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:194:5 › Audio player › should be correctly rendered - light theme with monospace font @no-firefox @no-webkit @screenshot
200 passed (17.9m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-Chrome-1
Expired
|
6.13 MB |
sha256:b6314fa8c5a92490679c235dfb0cc451f95bd51245c43f46969edbd47e867ef0
|
|
|
blob-report-Chrome-2
Expired
|
8.83 MB |
sha256:b5db169659a57b567e3c3d0f4f572aefcf795a996ad9d4d113ab7ea63f7b16ce
|
|
|
blob-report-Chrome-3
Expired
|
7.4 MB |
sha256:83842ab870c6783254806aafd31455bfaaf115e3ed09841401816f9e69b8a5d9
|
|
|
blob-report-Chrome-4
Expired
|
30.2 MB |
sha256:161141d532c04892530373e172af3b09f5ceec71f6a27e0bb65325af7e66e6d7
|
|
|
blob-report-modules
Expired
|
219 KB |
sha256:18a4d5481ca8ab73ca6cd35ca3511d9405b986888c3ec12b70095c143fe2bca4
|
|
|
html-report
|
49.3 MB |
sha256:912ae677f67c4012eb2fadce42bf424f23ae2dc7df04ff55427b9d767b5d8f2a
|
|
|
webapp
Expired
|
41.2 MB |
sha256:f79ca68c77cc433131aca383cf566b1d1429570613033ac9b0b44388c0b70625
|
|