-
Notifications
You must be signed in to change notification settings - Fork 41
[BENCH] x86_64: Benchmark alternative Keccak (#1) #1484
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: manastasova <[email protected]>
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mac Mini (M1, 2020) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
12316 cycles |
12315 cycles |
1.00 |
ML-KEM-512 encaps |
14989 cycles |
14989 cycles |
1 |
ML-KEM-512 decaps |
19558 cycles |
19557 cycles |
1.00 |
ML-KEM-768 keypair |
21084 cycles |
21084 cycles |
1 |
ML-KEM-768 encaps |
23868 cycles |
23867 cycles |
1.00 |
ML-KEM-768 decaps |
30436 cycles |
30436 cycles |
1 |
ML-KEM-1024 keypair |
30382 cycles |
30378 cycles |
1.00 |
ML-KEM-1024 encaps |
34655 cycles |
34654 cycles |
1.00 |
ML-KEM-1024 decaps |
44268 cycles |
44268 cycles |
1 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ppc64le (POWER10) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
58937 cycles |
58609 cycles |
1.01 |
ML-KEM-512 encaps |
71858 cycles |
71470 cycles |
1.01 |
ML-KEM-512 decaps |
91550 cycles |
91062 cycles |
1.01 |
ML-KEM-768 keypair |
95838 cycles |
95061 cycles |
1.01 |
ML-KEM-768 encaps |
111609 cycles |
110883 cycles |
1.01 |
ML-KEM-768 decaps |
137568 cycles |
136318 cycles |
1.01 |
ML-KEM-1024 keypair |
155618 cycles |
154856 cycles |
1.00 |
ML-KEM-1024 encaps |
174808 cycles |
173402 cycles |
1.01 |
ML-KEM-1024 decaps |
207007 cycles |
204939 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
9528 cycles |
9625 cycles |
0.99 |
ML-KEM-512 encaps |
11280 cycles |
11261 cycles |
1.00 |
ML-KEM-512 decaps |
15196 cycles |
15164 cycles |
1.00 |
ML-KEM-768 keypair |
16518 cycles |
16379 cycles |
1.01 |
ML-KEM-768 encaps |
17896 cycles |
17876 cycles |
1.00 |
ML-KEM-768 decaps |
23707 cycles |
23467 cycles |
1.01 |
ML-KEM-1024 keypair |
22821 cycles |
22351 cycles |
1.02 |
ML-KEM-1024 encaps |
24794 cycles |
24490 cycles |
1.01 |
ML-KEM-1024 decaps |
32612 cycles |
32226 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
14131 cycles |
16898 cycles |
0.84 |
ML-KEM-512 encaps |
15840 cycles |
18592 cycles |
0.85 |
ML-KEM-512 decaps |
21307 cycles |
24064 cycles |
0.89 |
ML-KEM-768 keypair |
24148 cycles |
28520 cycles |
0.85 |
ML-KEM-768 encaps |
25449 cycles |
29608 cycles |
0.86 |
ML-KEM-768 decaps |
33362 cycles |
37440 cycles |
0.89 |
ML-KEM-1024 keypair |
34816 cycles |
42905 cycles |
0.81 |
ML-KEM-1024 encaps |
36401 cycles |
44084 cycles |
0.83 |
ML-KEM-1024 decaps |
46962 cycles |
54546 cycles |
0.86 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i) (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
29251 cycles |
29267 cycles |
1.00 |
ML-KEM-512 encaps |
36656 cycles |
36676 cycles |
1.00 |
ML-KEM-512 decaps |
45206 cycles |
45180 cycles |
1.00 |
ML-KEM-768 keypair |
46011 cycles |
45976 cycles |
1.00 |
ML-KEM-768 encaps |
55628 cycles |
55681 cycles |
1.00 |
ML-KEM-768 decaps |
69305 cycles |
69239 cycles |
1.00 |
ML-KEM-1024 keypair |
72848 cycles |
72724 cycles |
1.00 |
ML-KEM-1024 encaps |
84745 cycles |
84820 cycles |
1.00 |
ML-KEM-1024 decaps |
102586 cycles |
102767 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
14887 cycles |
16250 cycles |
0.92 |
ML-KEM-512 encaps |
17123 cycles |
18593 cycles |
0.92 |
ML-KEM-512 decaps |
23879 cycles |
25256 cycles |
0.95 |
ML-KEM-768 keypair |
25633 cycles |
28059 cycles |
0.91 |
ML-KEM-768 encaps |
28934 cycles |
31904 cycles |
0.91 |
ML-KEM-768 decaps |
36949 cycles |
39398 cycles |
0.94 |
ML-KEM-1024 keypair |
34858 cycles |
37797 cycles |
0.92 |
ML-KEM-1024 encaps |
36709 cycles |
40503 cycles |
0.91 |
ML-KEM-1024 decaps |
50442 cycles |
54261 cycles |
0.93 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
17657 cycles |
17664 cycles |
1.00 |
ML-KEM-512 encaps |
20533 cycles |
20522 cycles |
1.00 |
ML-KEM-512 decaps |
26966 cycles |
26962 cycles |
1.00 |
ML-KEM-768 keypair |
29972 cycles |
29976 cycles |
1.00 |
ML-KEM-768 encaps |
32795 cycles |
32769 cycles |
1.00 |
ML-KEM-768 decaps |
41951 cycles |
41949 cycles |
1.00 |
ML-KEM-1024 keypair |
43842 cycles |
43864 cycles |
1.00 |
ML-KEM-1024 encaps |
48785 cycles |
48797 cycles |
1.00 |
ML-KEM-1024 decaps |
61399 cycles |
61312 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
18721 cycles |
18726 cycles |
1.00 |
ML-KEM-512 encaps |
21988 cycles |
21990 cycles |
1.00 |
ML-KEM-512 decaps |
28929 cycles |
28926 cycles |
1.00 |
ML-KEM-768 keypair |
31700 cycles |
31695 cycles |
1.00 |
ML-KEM-768 encaps |
34900 cycles |
34897 cycles |
1.00 |
ML-KEM-768 decaps |
44893 cycles |
44904 cycles |
1.00 |
ML-KEM-1024 keypair |
46306 cycles |
46310 cycles |
1.00 |
ML-KEM-1024 encaps |
51617 cycles |
51631 cycles |
1.00 |
ML-KEM-1024 decaps |
65123 cycles |
65063 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A55 (Snapdragon 888) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
59482 cycles |
59417 cycles |
1.00 |
ML-KEM-512 encaps |
67194 cycles |
67139 cycles |
1.00 |
ML-KEM-512 decaps |
86015 cycles |
85868 cycles |
1.00 |
ML-KEM-768 keypair |
96923 cycles |
96902 cycles |
1.00 |
ML-KEM-768 encaps |
110374 cycles |
110211 cycles |
1.00 |
ML-KEM-768 decaps |
137090 cycles |
137410 cycles |
1.00 |
ML-KEM-1024 keypair |
154113 cycles |
153909 cycles |
1.00 |
ML-KEM-1024 encaps |
170999 cycles |
170400 cycles |
1.00 |
ML-KEM-1024 decaps |
206945 cycles |
206601 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a) (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
40133 cycles |
40063 cycles |
1.00 |
ML-KEM-512 encaps |
48493 cycles |
48449 cycles |
1.00 |
ML-KEM-512 decaps |
62853 cycles |
62704 cycles |
1.00 |
ML-KEM-768 keypair |
63694 cycles |
63580 cycles |
1.00 |
ML-KEM-768 encaps |
74985 cycles |
74811 cycles |
1.00 |
ML-KEM-768 decaps |
93686 cycles |
93436 cycles |
1.00 |
ML-KEM-1024 keypair |
95717 cycles |
95232 cycles |
1.01 |
ML-KEM-1024 encaps |
110058 cycles |
109437 cycles |
1.01 |
ML-KEM-1024 decaps |
133141 cycles |
132545 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4 (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
35476 cycles |
35452 cycles |
1.00 |
ML-KEM-512 encaps |
40558 cycles |
40519 cycles |
1.00 |
ML-KEM-512 decaps |
51260 cycles |
51291 cycles |
1.00 |
ML-KEM-768 keypair |
57114 cycles |
57158 cycles |
1.00 |
ML-KEM-768 encaps |
64702 cycles |
65307 cycles |
0.99 |
ML-KEM-768 decaps |
79339 cycles |
79757 cycles |
0.99 |
ML-KEM-1024 keypair |
88044 cycles |
88019 cycles |
1.00 |
ML-KEM-1024 encaps |
97533 cycles |
97622 cycles |
1.00 |
ML-KEM-1024 decaps |
116462 cycles |
116481 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i) (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
47168 cycles |
47179 cycles |
1.00 |
ML-KEM-512 encaps |
55647 cycles |
55651 cycles |
1.00 |
ML-KEM-512 decaps |
71008 cycles |
71018 cycles |
1.00 |
ML-KEM-768 keypair |
73280 cycles |
73292 cycles |
1.00 |
ML-KEM-768 encaps |
85137 cycles |
85170 cycles |
1.00 |
ML-KEM-768 decaps |
105433 cycles |
105463 cycles |
1.00 |
ML-KEM-1024 keypair |
112732 cycles |
112706 cycles |
1.00 |
ML-KEM-1024 encaps |
125619 cycles |
125595 cycles |
1.00 |
ML-KEM-1024 decaps |
151809 cycles |
151812 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
10655 cycles |
11911 cycles |
0.89 |
ML-KEM-512 encaps |
12244 cycles |
13470 cycles |
0.91 |
ML-KEM-512 decaps |
17175 cycles |
18367 cycles |
0.94 |
ML-KEM-768 keypair |
18728 cycles |
20274 cycles |
0.92 |
ML-KEM-768 encaps |
19768 cycles |
21295 cycles |
0.93 |
ML-KEM-768 decaps |
26937 cycles |
28322 cycles |
0.95 |
ML-KEM-1024 keypair |
25273 cycles |
27571 cycles |
0.92 |
ML-KEM-1024 encaps |
27321 cycles |
29429 cycles |
0.93 |
ML-KEM-1024 decaps |
36789 cycles |
38939 cycles |
0.94 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
28304 cycles |
28264 cycles |
1.00 |
ML-KEM-512 encaps |
34122 cycles |
34161 cycles |
1.00 |
ML-KEM-512 decaps |
44344 cycles |
44402 cycles |
1.00 |
ML-KEM-768 keypair |
47798 cycles |
47752 cycles |
1.00 |
ML-KEM-768 encaps |
54081 cycles |
54108 cycles |
1.00 |
ML-KEM-768 decaps |
68498 cycles |
68467 cycles |
1.00 |
ML-KEM-1024 keypair |
70426 cycles |
70508 cycles |
1.00 |
ML-KEM-1024 encaps |
78901 cycles |
78973 cycles |
1.00 |
ML-KEM-1024 decaps |
98619 cycles |
98511 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3 (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
39071 cycles |
39044 cycles |
1.00 |
ML-KEM-512 encaps |
44906 cycles |
44876 cycles |
1.00 |
ML-KEM-512 decaps |
56807 cycles |
56828 cycles |
1.00 |
ML-KEM-768 keypair |
62490 cycles |
62544 cycles |
1.00 |
ML-KEM-768 encaps |
71081 cycles |
71848 cycles |
0.99 |
ML-KEM-768 decaps |
87239 cycles |
88231 cycles |
0.99 |
ML-KEM-1024 keypair |
96280 cycles |
96222 cycles |
1.00 |
ML-KEM-1024 encaps |
106594 cycles |
106760 cycles |
1.00 |
ML-KEM-1024 decaps |
127095 cycles |
127083 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a) (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
36854 cycles |
36858 cycles |
1.00 |
ML-KEM-512 encaps |
43424 cycles |
43499 cycles |
1.00 |
ML-KEM-512 decaps |
56474 cycles |
56468 cycles |
1.00 |
ML-KEM-768 keypair |
58947 cycles |
58994 cycles |
1.00 |
ML-KEM-768 encaps |
67977 cycles |
67944 cycles |
1.00 |
ML-KEM-768 decaps |
85337 cycles |
85324 cycles |
1.00 |
ML-KEM-1024 keypair |
89173 cycles |
89191 cycles |
1.00 |
ML-KEM-1024 encaps |
99555 cycles |
99540 cycles |
1.00 |
ML-KEM-1024 decaps |
121771 cycles |
121698 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2 (no-opt)
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
59063 cycles |
59151 cycles |
1.00 |
ML-KEM-512 encaps |
68532 cycles |
68489 cycles |
1.00 |
ML-KEM-512 decaps |
87239 cycles |
87126 cycles |
1.00 |
ML-KEM-768 keypair |
95422 cycles |
95579 cycles |
1.00 |
ML-KEM-768 encaps |
109147 cycles |
109395 cycles |
1.00 |
ML-KEM-768 decaps |
135291 cycles |
134650 cycles |
1.00 |
ML-KEM-1024 keypair |
147436 cycles |
147999 cycles |
1.00 |
ML-KEM-1024 encaps |
163382 cycles |
163660 cycles |
1.00 |
ML-KEM-1024 decaps |
194921 cycles |
195255 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
SpacemiT K1 8 (Banana Pi F3) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
155060 cycles |
154986 cycles |
1.00 |
ML-KEM-512 encaps |
163060 cycles |
162936 cycles |
1.00 |
ML-KEM-512 decaps |
206226 cycles |
206098 cycles |
1.00 |
ML-KEM-768 keypair |
250021 cycles |
249874 cycles |
1.00 |
ML-KEM-768 encaps |
269375 cycles |
269171 cycles |
1.00 |
ML-KEM-768 decaps |
332798 cycles |
332517 cycles |
1.00 |
ML-KEM-1024 keypair |
395919 cycles |
395324 cycles |
1.00 |
ML-KEM-1024 encaps |
423252 cycles |
423158 cycles |
1.00 |
ML-KEM-1024 decaps |
507141 cycles |
505518 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
28296 cycles |
28271 cycles |
1.00 |
ML-KEM-512 encaps |
34132 cycles |
34173 cycles |
1.00 |
ML-KEM-512 decaps |
44364 cycles |
44385 cycles |
1.00 |
ML-KEM-768 keypair |
47773 cycles |
47761 cycles |
1.00 |
ML-KEM-768 encaps |
54072 cycles |
54100 cycles |
1.00 |
ML-KEM-768 decaps |
68470 cycles |
68455 cycles |
1.00 |
ML-KEM-1024 keypair |
70397 cycles |
70462 cycles |
1.00 |
ML-KEM-1024 encaps |
78894 cycles |
78930 cycles |
1.00 |
ML-KEM-1024 decaps |
98581 cycles |
98530 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks
Details
| Benchmark suite | Current: 88e18fe | Previous: 70d3b1b | Ratio |
|---|---|---|---|
ML-KEM-512 keypair |
50747 cycles |
51720 cycles |
0.98 |
ML-KEM-512 encaps |
58958 cycles |
60244 cycles |
0.98 |
ML-KEM-512 decaps |
75987 cycles |
75279 cycles |
1.01 |
ML-KEM-768 keypair |
86438 cycles |
87370 cycles |
0.99 |
ML-KEM-768 encaps |
94432 cycles |
96230 cycles |
0.98 |
ML-KEM-768 decaps |
117137 cycles |
118439 cycles |
0.99 |
ML-KEM-1024 keypair |
130075 cycles |
130623 cycles |
1.00 |
ML-KEM-1024 encaps |
142042 cycles |
143260 cycles |
0.99 |
ML-KEM-1024 decaps |
173954 cycles |
174116 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
Copy of @manastasova's PR #1481 to allow benchmarking to run.