Skip to content

Commit 3c1fb7d

Browse files
committed
test(e2e) Run E2Es with --rerun-fails-report flag for better insight into reruns of test failures
Signed-off-by: Jared Watts <[email protected]>
1 parent f6e7c03 commit 3c1fb7d

File tree

2 files changed

+15
-6
lines changed

2 files changed

+15
-6
lines changed

.github/workflows/ci.yml

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ on:
88
# TODO(negz): Remove this and all references to the v2 branches below
99
# if/when v2 is merged into main. It's a temporary branch for v2 preview
1010
# development.
11-
- v2
11+
- v2
1212
pull_request: {}
1313
workflow_dispatch: {}
1414

@@ -300,6 +300,13 @@ jobs:
300300
secret: ${{ secrets.BUILDPULSE_SECRET_ACCESS_KEY }}
301301
path: _output/tests/e2e-tests.xml
302302

303+
- name: Upload E2E Test Artifacts to GitHub
304+
if: '!cancelled()'
305+
uses: actions/upload-artifact@6f51ac03b9356f520e9adb1b1b7802705f340c2b # v4
306+
with:
307+
name: e2e-tests-${{ matrix.test-suite }}
308+
path: _output/tests/**
309+
303310
publish-artifacts:
304311
runs-on: ubuntu-22.04
305312

Earthfile

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -74,14 +74,16 @@ e2e:
7474
# https://github.com/earthly/earthly/issues/4143 is fixed.
7575
RUN gotestsum \
7676
--rerun-fails \
77-
--hide-summary output \ # See https://github.com/gotestyourself/gotestsum/issues/423
78-
--no-color=false \
79-
--format ${GOTESTSUM_FORMAT} \
80-
--junitfile e2e-tests.xml \
81-
--raw-command go tool test2json -t -p E2E ./e2e -test.v ${FLAGS}
77+
--rerun-fails-report e2e-rerun-fails.txt \
78+
--hide-summary output \ # See https://github.com/gotestyourself/gotestsum/issues/423
79+
--no-color=false \
80+
--format ${GOTESTSUM_FORMAT} \
81+
--junitfile e2e-tests.xml \
82+
--raw-command go tool test2json -t -p E2E ./e2e -test.v ${FLAGS}
8283
END
8384
FINALLY
8485
SAVE ARTIFACT --if-exists e2e-tests.xml AS LOCAL _output/tests/e2e-tests.xml
86+
SAVE ARTIFACT --if-exists e2e-rerun-fails.txt AS LOCAL _output/tests/e2e-rerun-fails.txt
8587
END
8688

8789
# hack builds Crossplane, and deploys it to a kind cluster. It runs in your

0 commit comments

Comments
 (0)