Skip to content

Update UI tests for large notebooks #14

Update UI tests for large notebooks

Update UI tests for large notebooks #14

Triggered via pull request April 3, 2025 14:36
Status Failure
Total duration 4m 46s
Artifacts 1

build.yaml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 notice
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid: ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L30
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid Error: expect(Buffer).toMatchSnapshot(expected) 16453 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-diff.png 28 | await page.waitForTimeout(1000); 29 | > 30 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png"); | ^ 31 | }); 32 | }); 33 | at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:30:37
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid: ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L30
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 16290 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-diff.png 28 | await page.waitForTimeout(1000); 29 | > 30 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png"); | ^ 31 | }); 32 | }); 33 | at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:30:37
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact: ui-tests/ipywidgets-test/ipywidgets.spec.ts#L30
2) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact Error: expect(Buffer).toMatchSnapshot(expected) 22870 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-diff.png 28 | await expect(button).toBeVisible(); 29 | > 30 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png"); | ^ 31 | 32 | await button.click(); 33 | await page.waitForTimeout(500); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:30:37
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact: ui-tests/ipywidgets-test/ipywidgets.spec.ts#L30
2) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 22870 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-diff.png 28 | await expect(button).toBeVisible(); 29 | > 30 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png"); | ^ 31 | 32 | await button.click(); 33 | await page.waitForTimeout(500); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:30:37
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook: ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts#L21
3) ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook Error: expect(Buffer).toMatchSnapshot(expected) 21395 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts-snapshots/before-format-notebook-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook/before-format-notebook-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook/before-format-notebook-diff.png 19 | await page.waitForTimeout(5000); 20 | > 21 | expect(await page.screenshot()).toMatchSnapshot( | ^ 22 | "before_format_notebook.png" 23 | ); 24 | at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:21:37
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook: ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts#L21
3) ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 21395 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts-snapshots/before-format-notebook-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook-retry1/before-format-notebook-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook-retry1/before-format-notebook-diff.png 19 | await page.waitForTimeout(5000); 20 | > 21 | expect(await page.screenshot()).toMatchSnapshot( | ^ 22 | "before_format_notebook.png" 23 | ); 24 | at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:21:37
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog: ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts#L53
4) ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog Error: expect(Buffer).toMatchSnapshot(expected) 34678 pixels (ratio 0.05 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts-snapshots/clone-repo-dialog-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-diff.png 51 | 52 | await openRepoButton.click(); > 53 | expect(await page.screenshot()).toMatchSnapshot("clone_repo_dialog.png"); | ^ 54 | }); 55 | test("should open Git Menu", async ({ page }) => { 56 | await page.goto(); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:53:37
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog: ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts#L53
4) ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) 34678 pixels (ratio 0.05 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts-snapshots/clone-repo-dialog-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog-retry1/clone-repo-dialog-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog-retry1/clone-repo-dialog-diff.png 51 | 52 | await openRepoButton.click(); > 53 | expect(await page.screenshot()).toMatchSnapshot("clone_repo_dialog.png"); | ^ 54 | }); 55 | test("should open Git Menu", async ({ page }) => { 56 | await page.goto(); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:53:37
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section: ui-tests/jupytext-test/jupytext.spec.ts#L15
5) ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section Error: expect(Buffer).toMatchSnapshot(expected) Expected an image 526px by 188px, received 526px by 184px. 2521 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts-snapshots/launcher-section-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section/launcher-section-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section/launcher-section-diff.png 13 | await expect(launcherSection).toBeVisible(); 14 | > 15 | expect(await launcherSection.screenshot()).toMatchSnapshot( | ^ 16 | "launcher-section.png" 17 | ); 18 | }); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts:15:48
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section: ui-tests/jupytext-test/jupytext.spec.ts#L15
5) ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(Buffer).toMatchSnapshot(expected) Expected an image 526px by 188px, received 526px by 184px. 2521 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts-snapshots/launcher-section-linux.png Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section-retry1/launcher-section-actual.png Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section-retry1/launcher-section-diff.png 13 | await expect(launcherSection).toBeVisible(); 14 | > 15 | expect(await launcherSection.screenshot()).toMatchSnapshot( | ^ 16 | "launcher-section.png" 17 | ); 18 | }); at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts:15:48
🎭 Playwright Run Summary
9 failed ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section ui-tests/papermill-test/papermill.spec.ts:6:7 › Papermill Execution Test › should run notebook with papermill and verify execution ui-tests/python-lsp-server-test/python_lsp_server.spec.ts:6:7 › Jupyterlab-lsp Extension Test › should open lsp popup ui-tests/ui.spec.ts:8:7 › Large Notebook Performance Benchmark › should perform benchmark operations ui-tests/voila-test/voila.spec.ts:6:7 › Voila Extension Test › should render notebook with voila 7 passed (3.1m)

Artifacts

Produced during runtime
Name Size Digest
playwright-tests Expired
22.8 MB
sha256:f21f3e598020737a7d7e0ff0b5c4807d63d0107d659dfaf442f7b789f72e9b0a