Commit 694f2b5
committed
fix: add min-threshold to baseline comparison CI test
The baseline comparison test was failing intermittently because:
- Fast policies (~200µs) showed large percentage swings (72%)
- Absolute differences were small (~170µs) - normal CI variance
- 50% threshold alone couldn't account for this
Adding --min-threshold 500µs ensures regressions only fail when BOTH:
1. Percentage exceeds threshold (50%), AND
2. Absolute time exceeds min-threshold (500µs)
This is exactly the scenario min-threshold was designed to handle.
Signed-off-by: Sertac Ozercan <[email protected]>1 parent 40cd80d commit 694f2b5
1 file changed
+4
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
123 | 123 | | |
124 | 124 | | |
125 | 125 | | |
126 | | - | |
| 126 | + | |
| 127 | + | |
127 | 128 | | |
128 | 129 | | |
129 | 130 | | |
130 | 131 | | |
131 | | - | |
| 132 | + | |
| 133 | + | |
132 | 134 | | |
133 | 135 | | |
134 | 136 | | |
| |||
0 commit comments