Update UI tests for large notebooks #14
Annotations
10 errors and 1 notice
|
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid:
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L30
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
Error: expect(Buffer).toMatchSnapshot(expected)
16453 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-diff.png
28 | await page.waitForTimeout(1000);
29 |
> 30 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png");
| ^
31 | });
32 | });
33 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:30:37
|
|
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid:
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L30
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
16290 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-diff.png
28 | await page.waitForTimeout(1000);
29 |
> 30 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png");
| ^
31 | });
32 | });
33 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:30:37
|
|
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact:
ui-tests/ipywidgets-test/ipywidgets.spec.ts#L30
2) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
Error: expect(Buffer).toMatchSnapshot(expected)
22870 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-diff.png
28 | await expect(button).toBeVisible();
29 |
> 30 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png");
| ^
31 |
32 | await button.click();
33 | await page.waitForTimeout(500);
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:30:37
|
|
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact:
ui-tests/ipywidgets-test/ipywidgets.spec.ts#L30
2) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
22870 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-diff.png
28 | await expect(button).toBeVisible();
29 |
> 30 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png");
| ^
31 |
32 | await button.click();
33 | await page.waitForTimeout(500);
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:30:37
|
|
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook:
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts#L21
3) ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook
Error: expect(Buffer).toMatchSnapshot(expected)
21395 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts-snapshots/before-format-notebook-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook/before-format-notebook-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook/before-format-notebook-diff.png
19 | await page.waitForTimeout(5000);
20 |
> 21 | expect(await page.screenshot()).toMatchSnapshot(
| ^
22 | "before_format_notebook.png"
23 | );
24 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:21:37
|
|
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook:
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts#L21
3) ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
21395 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts-snapshots/before-format-notebook-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook-retry1/before-format-notebook-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-code-f-0a1ad-tter-should-format-notebook-retry1/before-format-notebook-diff.png
19 | await page.waitForTimeout(5000);
20 |
> 21 | expect(await page.screenshot()).toMatchSnapshot(
| ^
22 | "before_format_notebook.png"
23 | );
24 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:21:37
|
|
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog:
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts#L53
4) ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog
Error: expect(Buffer).toMatchSnapshot(expected)
34678 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts-snapshots/clone-repo-dialog-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-diff.png
51 |
52 | await openRepoButton.click();
> 53 | expect(await page.screenshot()).toMatchSnapshot("clone_repo_dialog.png");
| ^
54 | });
55 | test("should open Git Menu", async ({ page }) => {
56 | await page.goto();
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:53:37
|
|
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog:
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts#L53
4) ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
34678 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts-snapshots/clone-repo-dialog-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog-retry1/clone-repo-dialog-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog-retry1/clone-repo-dialog-diff.png
51 |
52 | await openRepoButton.click();
> 53 | expect(await page.screenshot()).toMatchSnapshot("clone_repo_dialog.png");
| ^
54 | });
55 | test("should open Git Menu", async ({ page }) => {
56 | await page.goto();
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:53:37
|
|
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section:
ui-tests/jupytext-test/jupytext.spec.ts#L15
5) ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section
Error: expect(Buffer).toMatchSnapshot(expected)
Expected an image 526px by 188px, received 526px by 184px. 2521 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts-snapshots/launcher-section-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section/launcher-section-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section/launcher-section-diff.png
13 | await expect(launcherSection).toBeVisible();
14 |
> 15 | expect(await launcherSection.screenshot()).toMatchSnapshot(
| ^
16 | "launcher-section.png"
17 | );
18 | });
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts:15:48
|
|
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section:
ui-tests/jupytext-test/jupytext.spec.ts#L15
5) ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
Expected an image 526px by 188px, received 526px by 184px. 2521 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts-snapshots/launcher-section-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section-retry1/launcher-section-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupytext-test-jup-54d12-y-Jupytext-launcher-section-retry1/launcher-section-diff.png
13 | await expect(launcherSection).toBeVisible();
14 |
> 15 | expect(await launcherSection.screenshot()).toMatchSnapshot(
| ^
16 | "launcher-section.png"
17 | );
18 | });
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupytext-test/jupytext.spec.ts:15:48
|
|
🎭 Playwright Run Summary
9 failed
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
ui-tests/jupyterlab-code-formatter-test/jupyterlab_code_formatter.spec.ts:6:7 › JupyterLab Code Formatter › should format notebook
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section
ui-tests/papermill-test/papermill.spec.ts:6:7 › Papermill Execution Test › should run notebook with papermill and verify execution
ui-tests/python-lsp-server-test/python_lsp_server.spec.ts:6:7 › Jupyterlab-lsp Extension Test › should open lsp popup
ui-tests/ui.spec.ts:8:7 › Large Notebook Performance Benchmark › should perform benchmark operations
ui-tests/voila-test/voila.spec.ts:6:7 › Voila Extension Test › should render notebook with voila
7 passed (3.1m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
playwright-tests
Expired
|
22.8 MB |
sha256:f21f3e598020737a7d7e0ff0b5c4807d63d0107d659dfaf442f7b789f72e9b0a
|
|