Skip to content

Commit 491de5d

Browse files
authored
Skip flaky e2e tests in Firefox and Webkit (#2425)
## Motivation for the change, related issues Skips the two tests responsible for most failed CI runs: * `HTTPS requests via curl_exec() should work` in Firefox and Webkit * `Should translate WP-admin to Spanish for the nightly/beta WordPress build` in Firefox and Webkit The scenarios pass in Chrome and also work in manual testing on localhost and playground.wordpress.net. While finding the root cause will be highly useful, accepting a red X as the norm is highly unuseful and makes us miss actual failures. ## Testing instructions Confirm the CI checks pass. FYI @brandonpayton @zaerl @JanJakes @fellyph
1 parent 0e5aac6 commit 491de5d

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

packages/playground/website/playwright/e2e/blueprints.spec.ts

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -251,7 +251,14 @@ test('Intl functions should work when intl is enabled', async ({
251251
test('HTTPS requests via curl_exec() should work', async ({
252252
website,
253253
wordpress,
254+
browserName,
254255
}) => {
256+
test.skip(
257+
browserName === 'firefox' || browserName === 'webkit',
258+
`The curl_exec() tests often fail in CI on Firefox and WebKit. The root cause is unknown, ` +
259+
'but the issue does not occur in local testing or on https://playground.wordpress.net/. ' +
260+
'Perhaps it is something highly specific to the CI runtime.'
261+
);
255262
const blueprint: Blueprint = {
256263
landingPage: '/curl-test.php',
257264
features: { networking: true },
@@ -553,7 +560,15 @@ test('should correctly redirect to a multisite wp-admin url', async ({
553560
test(`should translate WP-admin to Spanish for the ${wpVersion} WordPress build`, async ({
554561
website,
555562
wordpress,
563+
browserName,
556564
}) => {
565+
test.skip(
566+
(wpVersion === 'nightly' || wpVersion === 'beta') &&
567+
(browserName === 'firefox' || browserName === 'webkit'),
568+
`The translation tests often fail in CI on Firefox and WebKit. The root cause is unknown, ` +
569+
'but the issue does not occur in local testing or on https://playground.wordpress.net/. ' +
570+
'Perhaps it is something highly specific to the CI runtime.'
571+
);
557572
const blueprint: Blueprint = {
558573
landingPage: '/wp-admin/',
559574
preferredVersions: {

0 commit comments

Comments
 (0)