Try to reduce benchmark drift

[prymitive]

No description provided.

[github-actions]

This pull request was validated by pint.

✔️ No problems found

Stats

Stat	Value
Version	v0.79.0-28-g1e684133
Number of rules parsed	9
Number of rules checked	9
Number of problems found	0
Number of offline checks	0
Number of online checks	0
Checks duration	0

Problems

No problems reported

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.56%. Comparing base (18152ba) to head (1e68413).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1718   +/-   ##
=======================================
  Coverage   99.56%   99.56%           
=======================================
  Files         109      109           
  Lines       13215    13215           
=======================================
  Hits        13158    13158           
  Misses         32       32           
  Partials       25       25           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions]

Benchmark diff:

goos: linux
goarch: amd64
pkg: github.com/cloudflare/pint/cmd/pint
cpu: AMD EPYC 7763 64-Core Processor                
                    │   old.txt    │               new.txt                │
                    │    sec/op    │   sec/op     vs base                 │
GlobFinder-4          18.96m ± ∞ ¹   19.00m ± 3%       ~ (p=0.859 n=5+10)
GitFinder-4           401.0m ± ∞ ¹   402.5m ± 1%       ~ (p=0.594 n=5+10)
CheckRules-4           9.420 ± ∞ ¹    9.615 ± 1%  +2.07% (p=0.001 n=5+10)
RuleIsIdentical-4     5.274m ± ∞ ¹   5.288m ± 0%       ~ (p=0.371 n=5+10)
GetChecksForEntry-4   109.3m ± ∞ ¹   112.5m ± 2%  +2.96% (p=0.001 n=5+10)
geomean               132.8m         134.3m       +1.17%
¹ need >= 6 samples for confidence interval at level 0.95

                    │    old.txt     │                 new.txt                  │
                    │      B/op      │     B/op       vs base                   │
GlobFinder-4           7.134Mi ± ∞ ¹    7.134Mi ± 0%       ~ (p=0.594 n=5+10)
GitFinder-4            16.05Mi ± ∞ ¹    16.09Mi ± 1%       ~ (p=0.129 n=5+10)
CheckRules-4          1000.5Mi ± ∞ ¹   1004.8Mi ± 0%       ~ (p=0.055 n=5+10)
RuleIsIdentical-4        0.000 ± ∞ ¹      0.000 ± 0%       ~ (p=1.000 n=5+10) ²
GetChecksForEntry-4    56.55Mi ± ∞ ¹    56.55Mi ± 0%  -0.00% (p=0.001 n=5+10)
geomean                            ³                  +0.13%                  ³
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ summaries must be >0 to compute geomean

                    │   old.txt    │                new.txt                 │
                    │  allocs/op   │  allocs/op   vs base                   │
GlobFinder-4          111.0k ± ∞ ¹   111.0k ± 0%       ~ (p=0.813 n=5+10)
GitFinder-4           148.7k ± ∞ ¹   148.7k ± 0%       ~ (p=0.107 n=5+10)
CheckRules-4          14.51M ± ∞ ¹   14.53M ± 0%  +0.20% (p=0.001 n=5+10)
RuleIsIdentical-4      0.000 ± ∞ ¹    0.000 ± 0%       ~ (p=1.000 n=5+10) ²
GetChecksForEntry-4   916.3k ± ∞ ¹   916.3k ± 0%  -0.00% (n=5+10)
geomean                          ³                +0.04%                  ³
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ summaries must be >0 to compute geomean

pkg: github.com/cloudflare/pint/internal/parser
        │   old.txt    │             new.txt             │
        │    sec/op    │   sec/op     vs base            │
Parse-4   16.27m ± ∞ ¹   16.15m ± 2%  ~ (p=0.075 n=5+10)
¹ need >= 6 samples for confidence interval at level 0.95

        │    old.txt    │             new.txt              │
        │     B/op      │     B/op      vs base            │
Parse-4   6.306Mi ± ∞ ¹   6.306Mi ± 0%  ~ (p=0.254 n=5+10)
¹ need >= 6 samples for confidence interval at level 0.95

        │   old.txt    │              new.txt              │
        │  allocs/op   │  allocs/op   vs base              │
Parse-4   102.7k ± ∞ ¹   102.7k ± 0%  ~ (p=1.000 n=5+10) ²
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal

pkg: github.com/cloudflare/pint/internal/parser/source
               │   old.txt    │             new.txt             │
               │    sec/op    │   sec/op     vs base            │
LabelsSource-4   5.646m ± ∞ ¹   5.616m ± 1%  ~ (p=0.254 n=5+10)
¹ need >= 6 samples for confidence interval at level 0.95

               │    old.txt    │             new.txt              │
               │     B/op      │     B/op      vs base            │
LabelsSource-4   4.439Mi ± ∞ ¹   4.440Mi ± 0%  ~ (p=0.594 n=5+10)
¹ need >= 6 samples for confidence interval at level 0.95

               │   old.txt    │             new.txt             │
               │  allocs/op   │  allocs/op   vs base            │
LabelsSource-4   36.34k ± ∞ ¹   36.35k ± 0%  ~ (p=0.177 n=5+10)
¹ need >= 6 samples for confidence interval at level 0.95

pkg: github.com/cloudflare/pint/internal/promapi
                    │   old.txt    │                new.txt                 │
                    │    sec/op    │   sec/op     vs base                   │
QueryCacheOnlySet-4   103.0n ± ∞ ¹   103.8n ± 3%  +0.78% (p=0.011 n=5+10)
QueryCacheSetGrow-4   309.7n ± ∞ ¹
QueryCacheGetMiss-4   16.87n ± ∞ ¹
QueryCacheGC/0%-4     35.27µ ± ∞ ¹
QueryCacheGC/1%-4     35.73µ ± ∞ ¹
QueryCacheGC/10%-4    38.94µ ± ∞ ¹
QueryCacheGC/20%-4    73.46µ ± ∞ ¹
QueryCacheGC/25%-4    73.83µ ± ∞ ¹
QueryCacheGC/50%-4    71.69µ ± ∞ ¹
QueryCacheGC/75%-4    51.34µ ± ∞ ¹
QueryCacheGC/99%-4    51.38µ ± ∞ ¹
QueryCacheGC/100%-4   50.98µ ± ∞ ¹
geomean               10.27µ         103.8n       +0.78%                  ²
¹ need >= 6 samples for confidence interval at level 0.95
² benchmark set differs from baseline; geomeans may not be comparable

                    │    old.txt    │                new.txt                │
                    │     B/op      │    B/op     vs base                   │
QueryCacheOnlySet-4     64.00 ± ∞ ¹   64.00 ± 0%       ~ (p=1.000 n=5+10) ²
QueryCacheSetGrow-4     127.0 ± ∞ ¹
QueryCacheGetMiss-4     0.000 ± ∞ ¹
QueryCacheGC/0%-4       0.000 ± ∞ ¹
QueryCacheGC/1%-4       0.000 ± ∞ ¹
QueryCacheGC/10%-4      0.000 ± ∞ ¹
QueryCacheGC/20%-4    18.09Ki ± ∞ ¹
QueryCacheGC/25%-4    18.09Ki ± ∞ ¹
QueryCacheGC/50%-4    18.09Ki ± ∞ ¹
QueryCacheGC/75%-4      48.00 ± ∞ ¹
QueryCacheGC/99%-4      48.00 ± ∞ ¹
QueryCacheGC/100%-4     48.00 ± ∞ ¹
geomean                           ³   64.00       +0.00%                  ⁴
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ summaries must be >0 to compute geomean
⁴ benchmark set differs from baseline; geomeans may not be comparable

                    │   old.txt   │                new.txt                │
                    │  allocs/op  │ allocs/op   vs base                   │
QueryCacheOnlySet-4   1.000 ± ∞ ¹   1.000 ± 0%       ~ (p=1.000 n=5+10) ²
QueryCacheSetGrow-4   1.000 ± ∞ ¹
QueryCacheGetMiss-4   0.000 ± ∞ ¹
QueryCacheGC/0%-4     0.000 ± ∞ ¹
QueryCacheGC/1%-4     0.000 ± ∞ ¹
QueryCacheGC/10%-4    0.000 ± ∞ ¹
QueryCacheGC/20%-4    4.000 ± ∞ ¹
QueryCacheGC/25%-4    4.000 ± ∞ ¹
QueryCacheGC/50%-4    4.000 ± ∞ ¹
QueryCacheGC/75%-4    1.000 ± ∞ ¹
QueryCacheGC/99%-4    1.000 ± ∞ ¹
QueryCacheGC/100%-4   1.000 ± ∞ ¹
geomean                         ³   1.000       +0.00%                  ⁴
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ summaries must be >0 to compute geomean
⁴ benchmark set differs from baseline; geomeans may not be comparable