Create ui tests for jupyterlab extensions #5
Annotations
10 errors and 1 notice
|
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid:
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L19
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
Error: expect(Buffer).toMatchSnapshot(expected)
19970 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid/ipydatagrid-initial-diff.png
17 | await expect(gridCanvas).toBeVisible();
18 |
> 19 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png");
| ^
20 |
21 | });
22 | });
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:19:37
|
|
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid:
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L19
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
20042 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry1/ipydatagrid-initial-diff.png
17 | await expect(gridCanvas).toBeVisible();
18 |
> 19 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png");
| ^
20 |
21 | });
22 | });
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:19:37
|
|
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid:
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts#L19
1) ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
20116 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts-snapshots/ipydatagrid-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry2/ipydatagrid-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipydatagrid-test--83490-otebook-and-render-DataGrid-retry2/ipydatagrid-initial-diff.png
17 | await expect(gridCanvas).toBeVisible();
18 |
> 19 | expect(await page.screenshot()).toMatchSnapshot("ipydatagrid-initial.png");
| ^
20 |
21 | });
22 | });
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:19:37
|
|
ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure:
ui-tests/ipympl-test/ipympl.spec.ts#L27
2) ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure
Error: expect(Buffer).toMatchSnapshot(expected)
19598 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts-snapshots/ipympl-figure-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure/ipympl-figure-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure/ipympl-figure-diff.png
25 | await expect(toolbar).toBeVisible();
26 |
> 27 | expect(await page.screenshot()).toMatchSnapshot("ipympl-figure.png");
| ^
28 | });
29 | });
30 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts:27:37
|
|
ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure:
ui-tests/ipympl-test/ipympl.spec.ts#L27
2) ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
19587 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts-snapshots/ipympl-figure-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure-retry1/ipympl-figure-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure-retry1/ipympl-figure-diff.png
25 | await expect(toolbar).toBeVisible();
26 |
> 27 | expect(await page.screenshot()).toMatchSnapshot("ipympl-figure.png");
| ^
28 | });
29 | });
30 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts:27:37
|
|
ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure:
ui-tests/ipympl-test/ipympl.spec.ts#L27
2) ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
19587 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts-snapshots/ipympl-figure-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure-retry2/ipympl-figure-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipympl-test-ipymp-db8d5-teractive-Matplotlib-figure-retry2/ipympl-figure-diff.png
25 | await expect(toolbar).toBeVisible();
26 |
> 27 | expect(await page.screenshot()).toMatchSnapshot("ipympl-figure.png");
| ^
28 | });
29 | });
30 |
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipympl-test/ipympl.spec.ts:27:37
|
|
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact:
ui-tests/ipywidgets-test/ipywidgets.spec.ts#L22
3) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
Error: expect(Buffer).toMatchSnapshot(expected)
22961 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact/ipywidgets-initial-diff.png
20 | await expect(button).toBeVisible();
21 |
> 22 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png");
| ^
23 |
24 | await button.click();
25 | await page.waitForTimeout(500);
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:22:37
|
|
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact:
ui-tests/ipywidgets-test/ipywidgets.spec.ts#L22
3) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
22961 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry1/ipywidgets-initial-diff.png
20 | await expect(button).toBeVisible();
21 |
> 22 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png");
| ^
23 |
24 | await button.click();
25 | await page.waitForTimeout(500);
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:22:37
|
|
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact:
ui-tests/ipywidgets-test/ipywidgets.spec.ts#L22
3) ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
22961 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts-snapshots/ipywidgets-initial-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry2/ipywidgets-initial-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-ipywidgets-test-i-19fcd-render-widgets-and-interact-retry2/ipywidgets-initial-diff.png
20 | await expect(button).toBeVisible();
21 |
> 22 | expect(await page.screenshot()).toMatchSnapshot("ipywidgets-initial.png");
| ^
23 |
24 | await button.click();
25 | await page.waitForTimeout(500);
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/ipywidgets-test/ipywidgets.spec.ts:22:37
|
|
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog:
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts#L53
4) ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog
Error: expect(Buffer).toMatchSnapshot(expected)
34678 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts-snapshots/clone-repo-dialog-linux.png
Received: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-actual.png
Diff: /home/runner/work/jupyterlab-meta/jupyterlab-meta/test-results/ui-tests-jupyterlab-git-te-f0f8e-pen-Clone-repository-dialog/clone-repo-dialog-diff.png
51 |
52 | await openRepoButton.click();
> 53 | expect(await page.screenshot()).toMatchSnapshot("clone_repo_dialog.png");
| ^
54 | });
55 | test("should open Git Menu", async ({ page }) => {
56 | await page.goto();
at /home/runner/work/jupyterlab-meta/jupyterlab-meta/ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:53:37
|
|
🎭 Playwright Run Summary
7 failed
ui-tests/ipydatagrid-test/ipydatagrid.spec.ts:6:7 › ipydatagrid Extension › should execute notebook and render DataGrid
ui-tests/ipympl-test/ipympl.spec.ts:6:7 › ipympl Extension › should render an interactive Matplotlib figure
ui-tests/ipywidgets-test/ipywidgets.spec.ts:6:7 › ipywidgets Extension › should render widgets and interact
ui-tests/jupyterlab-git-test/jupyterlab_git.spec.ts:39:7 › JupyterLab Git Extension › should open Clone repository dialog
ui-tests/jupyterlab-lsp-test/jupyterlab_lsp.spec.ts:6:7 › Jupyterlab-lsp Extension Test › should open lsp popup
ui-tests/jupytext-test/jupytext.spec.ts:6:7 › Jupytext Extension › should display Jupytext launcher section
ui-tests/voila-test/voila.spec.ts:6:7 › Voila Extension Test › should render notebook with voila
9 passed (2.8m)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
playwright-tests
Expired
|
23.9 MB |
sha256:c9ea3289bfd95f7515b1e38500221d17c95c68cce1eb4ecde16bc617e0835a2b
|
|