Skip to content

Commit 2d69f5c

Browse files
naspiratoydbot
authored andcommitted
MUTE RULES: mute after 2=>3 fails (#25790)
1 parent 7082c9f commit 2d69f5c

File tree

2 files changed

+5
-4
lines changed

2 files changed

+5
-4
lines changed

.github/config/mute_rules.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,8 @@
33
---
44

55
### Mute a test if in the last 4 days:
6-
- **2 or more failures**
7-
- **OR** 1 failure and runs (pass + fail) not more than 10
6+
- **3 or more failures AND runs (pass + fail) more than 10**
7+
- **OR** 2 or more failures AND runs (pass + fail) not more than 10
88

99
### Unmute a test if in the last 7 days:
1010
- **Runs (pass + fail + mute) >= 4**
@@ -24,6 +24,7 @@
2424
---
2525

2626
**Example:**
27+
- If a test ran 15 times in 3 days with 3 failures — the test will be muted.
2728
- If a test ran 5 times in 3 days with 2 failures — the test will be muted.
2829
- If a test ran 4 times in 7 days and all passed successfully — the test will be unmuted.
2930
- If a test didn't run at all in 7 days — it will be removed from mute.
@@ -87,7 +88,7 @@ For analyzing test status, finding mute/unmute candidates, and tracking stabilit
8788

8889
### 🔇 [to_mute.txt](mute_update/to_mute.txt)
8990
**Content:** Mute candidates by new rules
90-
**Rules:** In 4 days ≥2 failures **OR** (≥1 failure and runs ≤10)
91+
**Rules:** In 4 days (≥3 failures **AND** runs >10) **OR** (≥2 failures **AND** runs ≤10)
9192
**Usage:** Main file for mute decisions
9293

9394
### 🔊 [to_unmute.txt](mute_update/to_unmute.txt)

.github/scripts/tests/create_new_muted_ya.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -360,7 +360,7 @@ def is_flaky_test(test, aggregated_data):
360360
return False
361361

362362
total_runs = test_data['pass_count'] + test_data['fail_count']
363-
return (test_data['fail_count'] >= 2) or (test_data['fail_count'] >= 1 and total_runs <= 10)
363+
return (test_data['fail_count'] >= 3 and total_runs > 10) or (test_data['fail_count'] >= 2 and total_runs <= 10)
364364

365365
def is_unmute_candidate(test, aggregated_data):
366366
"""Проверяет, является ли тест кандидатом на размьют за указанный период"""

0 commit comments

Comments
 (0)