Skip to content

Commit 6121826

Browse files
authored
[utils] remove flakiness in verbosity.py test case (#167801)
The rate at which lit's progress bar progresses is not deterministic. Don't try to match the contents of the progress bar, only the fact that it's there.
1 parent 4b805e1 commit 6121826

File tree

1 file changed

+26
-26
lines changed

1 file changed

+26
-26
lines changed

llvm/utils/lit/tests/verbosity.py

Lines changed: 26 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -47,9 +47,9 @@
4747
# SUCCINCT: -- Testing: 5 tests, 1 workers --
4848
# SUCCINCT-NEXT: Testing:
4949
# SUCCINCT-NEXT: FAIL: verbosity :: fail.txt (1 of 5)
50-
# SUCCINCT-NEXT: Testing: 0.. 10..
50+
# SUCCINCT-NEXT: Testing:
5151
# SUCCINCT-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
52-
# SUCCINCT-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
52+
# SUCCINCT-NEXT: Testing:
5353
# SUCCINCT-NEXT: ********************
5454
# SUCCINCT-NEXT: Failed Tests (1):
5555
# SUCCINCT-NEXT: verbosity :: fail.txt
@@ -561,15 +561,15 @@
561561
# PROGRESS: -- Testing: 5 tests, 1 workers --
562562
# PROGRESS-NEXT: Testing:
563563
# PROGRESS-NEXT: FAIL: verbosity :: fail.txt (1 of 5)
564-
# PROGRESS-NEXT: Testing: 0..
564+
# PROGRESS-NEXT: Testing:
565565
# PROGRESS-NEXT: PASS: verbosity :: pass.txt (2 of 5)
566-
# PROGRESS-NEXT: Testing: 0.. 10..
566+
# PROGRESS-NEXT: Testing:
567567
# PROGRESS-NEXT: {{UN}}SUPPORTED: verbosity :: unsupported.txt (3 of 5)
568-
# PROGRESS-NEXT: Testing: 0.. 10.. 20..
568+
# PROGRESS-NEXT: Testing:
569569
# PROGRESS-NEXT: {{X}}FAIL: verbosity :: xfail.txt (4 of 5)
570-
# PROGRESS-NEXT: Testing: 0.. 10.. 20.. 30..
570+
# PROGRESS-NEXT: Testing:
571571
# PROGRESS-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
572-
# PROGRESS-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
572+
# PROGRESS-NEXT: Testing:
573573
# PROGRESS-NEXT: ********************
574574
# PROGRESS-NEXT: Failed Tests (1):
575575
# PROGRESS-NEXT: verbosity :: fail.txt
@@ -643,7 +643,7 @@
643643
# AS-NEXT: --
644644
# AS-EMPTY:
645645
# AS-NEXT: ********************
646-
# AS-NEXT: Testing: 0.. 10..
646+
# AS-NEXT: Testing:
647647
# AS-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
648648
# AS-NEXT: ******************** TEST 'verbosity :: xpass.txt' FAILED ********************
649649
# AS-NEXT: Exit Code: 0
@@ -660,7 +660,7 @@
660660
# AS-NEXT: --
661661
# AS-EMPTY:
662662
# AS-NEXT: ********************
663-
# AS-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
663+
# AS-NEXT: Testing:
664664
# AS-NEXT: ********************
665665
# AS-NEXT: Failed Tests (1):
666666
# AS-NEXT: verbosity :: fail.txt
@@ -709,7 +709,7 @@
709709
# SA-NEXT: --
710710
# SA-EMPTY:
711711
# SA-NEXT: ********************
712-
# SA-NEXT: Testing: 0.. 10..
712+
# SA-NEXT: Testing:
713713
# SA-NEXT: PASS: verbosity :: pass.txt (2 of 5)
714714
# SA-NEXT: Exit Code: 0
715715
# SA-EMPTY:
@@ -725,11 +725,11 @@
725725
# SA-NEXT: --
726726
# SA-EMPTY:
727727
# SA-NEXT: ********************
728-
# SA-NEXT: Testing: 0.. 10.. 20..
728+
# SA-NEXT: Testing:
729729
# SA-NEXT: {{UN}}SUPPORTED: verbosity :: unsupported.txt (3 of 5)
730730
# SA-NEXT: Test requires the following unavailable features: asdf
731731
# SA-NEXT: ********************
732-
# SA-NEXT: Testing: 0.. 10.. 20.. 30..
732+
# SA-NEXT: Testing:
733733
# SA-NEXT: {{X}}FAIL: verbosity :: xfail.txt (4 of 5)
734734
# SA-NEXT: Exit Code: 1
735735
# SA-EMPTY:
@@ -746,7 +746,7 @@
746746
# SA-NEXT: --
747747
# SA-EMPTY:
748748
# SA-NEXT: ********************
749-
# SA-NEXT: Testing: 0.. 10.. 20.. 30.. 40..
749+
# SA-NEXT: Testing:
750750
# SA-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
751751
# SA-NEXT: ******************** TEST 'verbosity :: xpass.txt' FAILED ********************
752752
# SA-NEXT: Exit Code: 0
@@ -763,7 +763,7 @@
763763
# SA-NEXT: --
764764
# SA-EMPTY:
765765
# SA-NEXT: ********************
766-
# SA-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
766+
# SA-NEXT: Testing:
767767
# SA-NEXT: ********************
768768
# SA-NEXT: Failed Tests (1):
769769
# SA-NEXT: verbosity :: fail.txt
@@ -907,13 +907,13 @@
907907
# SQAV-NEXT: --
908908
# SQAV-EMPTY:
909909
# SQAV-NEXT: ********************
910-
# SQAV-NEXT: Testing: 0.. 10..
910+
# SQAV-NEXT: Testing:
911911
# SQAV-NEXT: PASS: verbosity :: pass.txt (2 of 5)
912-
# SQAV-NEXT: Testing: 0.. 10.. 20..
912+
# SQAV-NEXT: Testing:
913913
# SQAV-NEXT: {{UN}}SUPPORTED: verbosity :: unsupported.txt (3 of 5)
914-
# SQAV-NEXT: Testing: 0.. 10.. 20.. 30..
914+
# SQAV-NEXT: Testing:
915915
# SQAV-NEXT: {{X}}FAIL: verbosity :: xfail.txt (4 of 5)
916-
# SQAV-NEXT: Testing: 0.. 10.. 20.. 30.. 40..
916+
# SQAV-NEXT: Testing:
917917
# SQAV-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
918918
# SQAV-NEXT: ******************** TEST 'verbosity :: xpass.txt' FAILED ********************
919919
# SQAV-NEXT: Exit Code: 0
@@ -930,7 +930,7 @@
930930
# SQAV-NEXT: --
931931
# SQAV-EMPTY:
932932
# SQAV-NEXT: ********************
933-
# SQAV-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
933+
# SQAV-NEXT: Testing:
934934
# SQAV-NEXT: ********************
935935
# SQAV-NEXT: Failed Tests (1):
936936
# SQAV-NEXT: verbosity :: fail.txt
@@ -980,9 +980,9 @@
980980
# QUIET-W-PROGRESS: -- Testing: 5 tests, 1 workers --
981981
# QUIET-W-PROGRESS-NEXT: Testing:
982982
# QUIET-W-PROGRESS-NEXT: FAIL: verbosity :: fail.txt (1 of 5)
983-
# QUIET-W-PROGRESS-NEXT: Testing: 0.. 10..
983+
# QUIET-W-PROGRESS-NEXT: Testing:
984984
# QUIET-W-PROGRESS-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
985-
# QUIET-W-PROGRESS-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
985+
# QUIET-W-PROGRESS-NEXT: Testing:
986986
# QUIET-W-PROGRESS-NEXT: ********************
987987
# QUIET-W-PROGRESS-NEXT: Failed Tests (1):
988988
# QUIET-W-PROGRESS-NEXT: verbosity :: fail.txt
@@ -1102,15 +1102,15 @@
11021102
# SUCCINCT-RESULT-ALL: -- Testing: 5 tests, 1 workers --
11031103
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11041104
# SUCCINCT-RESULT-ALL-NEXT: FAIL: verbosity :: fail.txt (1 of 5)
1105-
# SUCCINCT-RESULT-ALL-NEXT: Testing: 0.. 10.
1105+
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11061106
# SUCCINCT-RESULT-ALL-NEXT: PASS: verbosity :: pass.txt (2 of 5)
1107-
# SUCCINCT-RESULT-ALL-NEXT: Testing: 0.. 10.. 20..
1107+
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11081108
# SUCCINCT-RESULT-ALL-NEXT: {{UN}}SUPPORTED: verbosity :: unsupported.txt (3 of 5)
1109-
# SUCCINCT-RESULT-ALL-NEXT: Testing: 0.. 10.. 20.. 30..
1109+
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11101110
# SUCCINCT-RESULT-ALL-NEXT: {{X}}FAIL: verbosity :: xfail.txt (4 of 5)
1111-
# SUCCINCT-RESULT-ALL-NEXT: Testing: 0.. 10.. 20.. 30.. 40..
1111+
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11121112
# SUCCINCT-RESULT-ALL-NEXT: XPASS: verbosity :: xpass.txt (5 of 5)
1113-
# SUCCINCT-RESULT-ALL-NEXT: Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90..
1113+
# SUCCINCT-RESULT-ALL-NEXT: Testing:
11141114
# SUCCINCT-RESULT-ALL-NEXT: ********************
11151115
# SUCCINCT-RESULT-ALL-NEXT: Failed Tests (1):
11161116
# SUCCINCT-RESULT-ALL-NEXT: verbosity :: fail.txt

0 commit comments

Comments
 (0)