Benchmark: report on alert only #7120
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Syntax Benchmarks
| Benchmark suite | Current: 33f0493 | Previous: e1b7fb7 | Ratio |
|---|---|---|---|
Parse RedBlackTree.res - time/run |
1.2050737133333334 ms |
1.2123143266666667 ms |
0.99 |
Parse RedBlackTree.res - allocs/run |
199057 words |
199057 words |
1 |
Print RedBlackTree.res - time/run |
2.3123508 ms |
2.3104395133333333 ms |
1.00 |
Print RedBlackTree.res - allocs/run |
236403 words |
236403 words |
1 |
Print RedBlackTreeNoComments.res - time/run |
2.1444886266666665 ms |
2.10057036 ms |
1.02 |
Print RedBlackTreeNoComments.res - allocs/run |
249186 words |
249186 words |
1 |
Parse Napkinscript.res - time/run |
39.443766366666665 ms |
39.28006235333333 ms |
1.00 |
Parse Napkinscript.res - allocs/run |
8670066 words |
8670066 words |
1 |
Print Napkinscript.res - time/run |
72.76365672666667 ms |
77.00100409999999 ms |
0.94 |
Print Napkinscript.res - allocs/run |
9776327 words |
9776327 words |
1 |
Parse HeroGraphic.res - time/run |
5.128570593333333 ms |
5.13472718 ms |
1.00 |
Parse HeroGraphic.res - allocs/run |
1219326 words |
1219326 words |
1 |
Print HeroGraphic.res - time/run |
8.660113246666667 ms |
8.775952553333333 ms |
0.99 |
Print HeroGraphic.res - allocs/run |
1396466 words |
1396466 words |
1 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Syntax Benchmarks'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.01.
| Benchmark suite | Current: 33f0493 | Previous: e1b7fb7 | Ratio |
|---|---|---|---|
Print RedBlackTreeNoComments.res - time/run |
2.1444886266666665 ms |
2.10057036 ms |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
cknitt
force-pushed
the
benchmark-threshold
branch
from
33f0493 to
ef118ca
Compare
cknitt
changed the title
fhammerschmidt
approved these changes
Oct 23, 2024
cknitt
referenced
this pull request
Oct 23, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In the future, as requested here, have the bot only comment if there is a >5% difference in benchmark results.