Commit 3c84623
Fix: trust test results over XHarness exit code
XHarness can report exit code 83 (APP_LAUNCH_FAILURE) even when
tests ran successfully (57 passed, 0 failed). This is a teardown/
cleanup issue, not a real test failure.
The parser was checking env error patterns (exit code 83) BEFORE
checking actual test results (Passed: 57). This caused the gate
to report ENV ERROR when tests actually passed.
Fix: check for actual test results (Passed: N where N > 0) FIRST.
If tests produced real results, trust them over the exit code.
Env error patterns only apply when zero tests ran.
Uses the LAST Passed:/Failed: counts in the log to handle cases
where Run-DeviceTests.ps1 retries internally and the log contains
multiple result blocks.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>1 parent 2dc6a10 commit 3c84623
File tree
1 file changed
+33
-2
lines changed- .github/skills/verify-tests-fail-without-fix/scripts
1 file changed
+33
-2
lines changedLines changed: 33 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
551 | 551 | | |
552 | 552 | | |
553 | 553 | | |
554 | | - | |
| 554 | + | |
| 555 | + | |
| 556 | + | |
| 557 | + | |
| 558 | + | |
| 559 | + | |
| 560 | + | |
| 561 | + | |
| 562 | + | |
| 563 | + | |
| 564 | + | |
| 565 | + | |
| 566 | + | |
| 567 | + | |
| 568 | + | |
| 569 | + | |
| 570 | + | |
| 571 | + | |
| 572 | + | |
| 573 | + | |
| 574 | + | |
| 575 | + | |
| 576 | + | |
| 577 | + | |
| 578 | + | |
| 579 | + | |
| 580 | + | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
555 | 587 | | |
556 | 588 | | |
557 | | - | |
558 | 589 | | |
559 | 590 | | |
560 | 591 | | |
| |||
0 commit comments