Skip to content

Conversation

@hanno-becker
Copy link
Contributor

No description provided.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 66539 cycles 46419 cycles 1.43
ML-DSA-44 sign 297881 cycles 131262 cycles 2.27
ML-DSA-44 verify 68056 cycles 47775 cycles 1.42
ML-DSA-65 keypair 116944 cycles 81329 cycles 1.44
ML-DSA-65 sign 612384 cycles 216976 cycles 2.82
ML-DSA-65 verify 115385 cycles 80085 cycles 1.44
ML-DSA-87 keypair 202255 cycles 132562 cycles 1.53
ML-DSA-87 sign 836392 cycles 277872 cycles 3.01
ML-DSA-87 verify 200245 cycles 130333 cycles 1.54

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Mac Mini (M1, 2020) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 66539 cycles 46419 cycles 1.43
ML-DSA-44 sign 297881 cycles 131262 cycles 2.27
ML-DSA-44 verify 68056 cycles 47775 cycles 1.42
ML-DSA-65 keypair 116944 cycles 81329 cycles 1.44
ML-DSA-65 sign 612384 cycles 216976 cycles 2.82
ML-DSA-65 verify 115385 cycles 80085 cycles 1.44
ML-DSA-87 keypair 202255 cycles 132562 cycles 1.53
ML-DSA-87 sign 836392 cycles 277872 cycles 3.01
ML-DSA-87 verify 200245 cycles 130333 cycles 1.54

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 112779 cycles 114346 cycles 0.99
ML-DSA-44 sign 622177 cycles 428752 cycles 1.45
ML-DSA-44 verify 120828 cycles 122296 cycles 0.99
ML-DSA-65 keypair 192458 cycles 195945 cycles 0.98
ML-DSA-65 sign 1171574 cycles 696914 cycles 1.68
ML-DSA-65 verify 194460 cycles 197606 cycles 0.98
ML-DSA-87 keypair 315935 cycles 322943 cycles 0.98
ML-DSA-87 sign 1522919 cycles 879234 cycles 1.73
ML-DSA-87 verify 321395 cycles 328114 cycles 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Mac Mini (M1, 2020) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 622177 cycles 428752 cycles 1.45
ML-DSA-65 sign 1171574 cycles 696914 cycles 1.68
ML-DSA-87 sign 1522919 cycles 879234 cycles 1.73

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 138474 cycles 113994 cycles 1.21
ML-DSA-44 sign 661749 cycles 360068 cycles 1.84
ML-DSA-44 verify 142307 cycles 117897 cycles 1.21
ML-DSA-65 keypair 240086 cycles 197659 cycles 1.21
ML-DSA-65 sign 1317630 cycles 593832 cycles 2.22
ML-DSA-65 verify 237190 cycles 194696 cycles 1.22
ML-DSA-87 keypair 409027 cycles 324031 cycles 1.26
ML-DSA-87 sign 1770450 cycles 758586 cycles 2.33
ML-DSA-87 verify 404871 cycles 320585 cycles 1.26

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 138474 cycles 113994 cycles 1.21
ML-DSA-44 sign 661749 cycles 360068 cycles 1.84
ML-DSA-44 verify 142307 cycles 117897 cycles 1.21
ML-DSA-65 keypair 240086 cycles 197659 cycles 1.21
ML-DSA-65 sign 1317630 cycles 593832 cycles 2.22
ML-DSA-65 verify 237190 cycles 194696 cycles 1.22
ML-DSA-87 keypair 409027 cycles 324031 cycles 1.26
ML-DSA-87 sign 1770450 cycles 758586 cycles 2.33
ML-DSA-87 verify 404871 cycles 320585 cycles 1.26

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 63699 cycles 34686 cycles 1.84
ML-DSA-44 sign 288332 cycles 120413 cycles 2.39
ML-DSA-44 verify 66949 cycles 38201 cycles 1.75
ML-DSA-65 keypair 111779 cycles 61058 cycles 1.83
ML-DSA-65 sign 592949 cycles 199188 cycles 2.98
ML-DSA-65 verify 112410 cycles 62665 cycles 1.79
ML-DSA-87 keypair 198364 cycles 94040 cycles 2.11
ML-DSA-87 sign 807607 cycles 232753 cycles 3.47
ML-DSA-87 verify 194936 cycles 94135 cycles 2.07

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 4th gen (c7i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 63699 cycles 34686 cycles 1.84
ML-DSA-44 sign 288332 cycles 120413 cycles 2.39
ML-DSA-44 verify 66949 cycles 38201 cycles 1.75
ML-DSA-65 keypair 111779 cycles 61058 cycles 1.83
ML-DSA-65 sign 592949 cycles 199188 cycles 2.98
ML-DSA-65 verify 112410 cycles 62665 cycles 1.79
ML-DSA-87 keypair 198364 cycles 94040 cycles 2.11
ML-DSA-87 sign 807607 cycles 232753 cycles 3.47
ML-DSA-87 verify 194936 cycles 94135 cycles 2.07

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 214042 cycles 213266 cycles 1.00
ML-DSA-44 sign 1160405 cycles 783843 cycles 1.48
ML-DSA-44 verify 229112 cycles 229070 cycles 1.00
ML-DSA-65 keypair 381123 cycles 381409 cycles 1.00
ML-DSA-65 sign 2205830 cycles 1272082 cycles 1.73
ML-DSA-65 verify 371370 cycles 371523 cycles 1.00
ML-DSA-87 keypair 604915 cycles 605807 cycles 1.00
ML-DSA-87 sign 2882623 cycles 1616853 cycles 1.78
ML-DSA-87 verify 616152 cycles 618042 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 1160405 cycles 783843 cycles 1.48
ML-DSA-65 sign 2205830 cycles 1272082 cycles 1.73
ML-DSA-87 sign 2882623 cycles 1616853 cycles 1.78

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 94182 cycles 69570 cycles 1.35
ML-DSA-44 sign 414984 cycles 184799 cycles 2.25
ML-DSA-44 verify 94212 cycles 69887 cycles 1.35
ML-DSA-65 keypair 163149 cycles 119092 cycles 1.37
ML-DSA-65 sign 844247 cycles 293638 cycles 2.88
ML-DSA-65 verify 159093 cycles 115066 cycles 1.38
ML-DSA-87 keypair 288219 cycles 208232 cycles 1.38
ML-DSA-87 sign 1166629 cycles 393913 cycles 2.96
ML-DSA-87 verify 279620 cycles 198515 cycles 1.41

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i) (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 95836 cycles 95766 cycles 1.00
ML-DSA-44 sign 501697 cycles 343767 cycles 1.46
ML-DSA-44 verify 100211 cycles 100067 cycles 1.00
ML-DSA-65 keypair 161451 cycles 161101 cycles 1.00
ML-DSA-65 sign 950576 cycles 549010 cycles 1.73
ML-DSA-65 verify 161845 cycles 162302 cycles 1.00
ML-DSA-87 keypair 265029 cycles 267325 cycles 0.99
ML-DSA-87 sign 1239669 cycles 712093 cycles 1.74
ML-DSA-87 verify 267205 cycles 269520 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 4th gen (c7i) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 501697 cycles 343767 cycles 1.46
ML-DSA-65 sign 950576 cycles 549010 cycles 1.73
ML-DSA-87 sign 1239669 cycles 712093 cycles 1.74

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 94182 cycles 69570 cycles 1.35
ML-DSA-44 sign 414984 cycles 184799 cycles 2.25
ML-DSA-44 verify 94212 cycles 69887 cycles 1.35
ML-DSA-65 keypair 163149 cycles 119092 cycles 1.37
ML-DSA-65 sign 844247 cycles 293638 cycles 2.88
ML-DSA-65 verify 159093 cycles 115066 cycles 1.38
ML-DSA-87 keypair 288219 cycles 208232 cycles 1.38
ML-DSA-87 sign 1166629 cycles 393913 cycles 2.96
ML-DSA-87 verify 279620 cycles 198515 cycles 1.41

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 102837 cycles 57058 cycles 1.80
ML-DSA-44 sign 455996 cycles 180684 cycles 2.52
ML-DSA-44 verify 107372 cycles 61118 cycles 1.76
ML-DSA-65 keypair 178814 cycles 99478 cycles 1.80
ML-DSA-65 sign 937802 cycles 296101 cycles 3.17
ML-DSA-65 verify 181043 cycles 100472 cycles 1.80
ML-DSA-87 keypair 315119 cycles 153597 cycles 2.05
ML-DSA-87 sign 1280913 cycles 351393 cycles 3.65
ML-DSA-87 verify 313026 cycles 152459 cycles 2.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 102837 cycles 57058 cycles 1.80
ML-DSA-44 sign 455996 cycles 180684 cycles 2.52
ML-DSA-44 verify 107372 cycles 61118 cycles 1.76
ML-DSA-65 keypair 178814 cycles 99478 cycles 1.80
ML-DSA-65 sign 937802 cycles 296101 cycles 3.17
ML-DSA-65 verify 181043 cycles 100472 cycles 1.80
ML-DSA-87 keypair 315119 cycles 153597 cycles 2.05
ML-DSA-87 sign 1280913 cycles 351393 cycles 3.65
ML-DSA-87 verify 313026 cycles 152459 cycles 2.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 247996 cycles 223847 cycles 1.11
ML-DSA-44 sign 1139912 cycles 611396 cycles 1.86
ML-DSA-44 verify 237882 cycles 222167 cycles 1.07
ML-DSA-65 keypair 426545 cycles 405270 cycles 1.05
ML-DSA-65 sign 2294636 cycles 1063318 cycles 2.16
ML-DSA-65 verify 414384 cycles 386574 cycles 1.07
ML-DSA-87 keypair 720729 cycles 677887 cycles 1.06
ML-DSA-87 sign 3067225 cycles 1389594 cycles 2.21
ML-DSA-87 verify 712234 cycles 642495 cycles 1.11

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 81059 cycles 41098 cycles 1.97
ML-DSA-44 sign 349432 cycles 130346 cycles 2.68
ML-DSA-44 verify 82759 cycles 43824 cycles 1.89
ML-DSA-65 keypair 139227 cycles 72772 cycles 1.91
ML-DSA-65 sign 724077 cycles 210942 cycles 3.43
ML-DSA-65 verify 139529 cycles 73377 cycles 1.90
ML-DSA-87 keypair 244174 cycles 110400 cycles 2.21
ML-DSA-87 sign 987439 cycles 248681 cycles 3.97
ML-DSA-87 verify 244245 cycles 110285 cycles 2.21

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a) (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 133574 cycles 134804 cycles 0.99
ML-DSA-44 sign 751778 cycles 534101 cycles 1.41
ML-DSA-44 verify 146575 cycles 147136 cycles 1.00
ML-DSA-65 keypair 224770 cycles 227270 cycles 0.99
ML-DSA-65 sign 1403053 cycles 871415 cycles 1.61
ML-DSA-65 verify 232871 cycles 235024 cycles 0.99
ML-DSA-87 keypair 368672 cycles 371039 cycles 0.99
ML-DSA-87 sign 1810664 cycles 1087295 cycles 1.67
ML-DSA-87 verify 380846 cycles 382727 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 81059 cycles 41098 cycles 1.97
ML-DSA-44 sign 349432 cycles 130346 cycles 2.68
ML-DSA-44 verify 82759 cycles 43824 cycles 1.89
ML-DSA-65 keypair 139227 cycles 72772 cycles 1.91
ML-DSA-65 sign 724077 cycles 210942 cycles 3.43
ML-DSA-65 verify 139529 cycles 73377 cycles 1.90
ML-DSA-87 keypair 244174 cycles 110400 cycles 2.21
ML-DSA-87 sign 987439 cycles 248681 cycles 3.97
ML-DSA-87 verify 244245 cycles 110285 cycles 2.21

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 91430 cycles 68739 cycles 1.33
ML-DSA-44 sign 420664 cycles 202219 cycles 2.08
ML-DSA-44 verify 92969 cycles 70923 cycles 1.31
ML-DSA-65 keypair 159146 cycles 121583 cycles 1.31
ML-DSA-65 sign 848589 cycles 331653 cycles 2.56
ML-DSA-65 verify 155909 cycles 117933 cycles 1.32
ML-DSA-87 keypair 273303 cycles 199015 cycles 1.37
ML-DSA-87 sign 1150998 cycles 427860 cycles 2.69
ML-DSA-87 verify 270287 cycles 195041 cycles 1.39

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 98288 cycles 72755 cycles 1.35
ML-DSA-44 sign 450438 cycles 212225 cycles 2.12
ML-DSA-44 verify 101221 cycles 75759 cycles 1.34
ML-DSA-65 keypair 172626 cycles 128385 cycles 1.34
ML-DSA-65 sign 915341 cycles 350358 cycles 2.61
ML-DSA-65 verify 169681 cycles 125560 cycles 1.35
ML-DSA-87 keypair 298182 cycles 209466 cycles 1.42
ML-DSA-87 sign 1246018 cycles 450433 cycles 2.77
ML-DSA-87 verify 294378 cycles 205205 cycles 1.43

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 247996 cycles 223847 cycles 1.11
ML-DSA-44 sign 1139912 cycles 611396 cycles 1.86
ML-DSA-44 verify 237882 cycles 222167 cycles 1.07
ML-DSA-65 keypair 426545 cycles 405270 cycles 1.05
ML-DSA-65 sign 2294636 cycles 1063318 cycles 2.16
ML-DSA-65 verify 414384 cycles 386574 cycles 1.07
ML-DSA-87 keypair 720729 cycles 677887 cycles 1.06
ML-DSA-87 sign 3067225 cycles 1389594 cycles 2.21
ML-DSA-87 verify 712234 cycles 642495 cycles 1.11

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 751778 cycles 534101 cycles 1.41
ML-DSA-65 sign 1403053 cycles 871415 cycles 1.61
ML-DSA-87 sign 1810664 cycles 1087295 cycles 1.67

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 98288 cycles 72755 cycles 1.35
ML-DSA-44 sign 450438 cycles 212225 cycles 2.12
ML-DSA-44 verify 101221 cycles 75759 cycles 1.34
ML-DSA-65 keypair 172626 cycles 128385 cycles 1.34
ML-DSA-65 sign 915341 cycles 350358 cycles 2.61
ML-DSA-65 verify 169681 cycles 125560 cycles 1.35
ML-DSA-87 keypair 298182 cycles 209466 cycles 1.42
ML-DSA-87 sign 1246018 cycles 450433 cycles 2.77
ML-DSA-87 verify 294378 cycles 205205 cycles 1.43

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 91430 cycles 68739 cycles 1.33
ML-DSA-44 sign 420664 cycles 202219 cycles 2.08
ML-DSA-44 verify 92969 cycles 70923 cycles 1.31
ML-DSA-65 keypair 159146 cycles 121583 cycles 1.31
ML-DSA-65 sign 848589 cycles 331653 cycles 2.56
ML-DSA-65 verify 155909 cycles 117933 cycles 1.32
ML-DSA-87 keypair 273303 cycles 199015 cycles 1.37
ML-DSA-87 sign 1150998 cycles 427860 cycles 2.69
ML-DSA-87 verify 270287 cycles 195041 cycles 1.39

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i) (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 151742 cycles 158829 cycles 0.96
ML-DSA-44 sign 823606 cycles 567095 cycles 1.45
ML-DSA-44 verify 163634 cycles 169814 cycles 0.96
ML-DSA-65 keypair 255998 cycles 268146 cycles 0.95
ML-DSA-65 sign 1542464 cycles 916167 cycles 1.68
ML-DSA-65 verify 262193 cycles 273883 cycles 0.96
ML-DSA-87 keypair 428089 cycles 450791 cycles 0.95
ML-DSA-87 sign 2035242 cycles 1174073 cycles 1.73
ML-DSA-87 verify 437402 cycles 459716 cycles 0.95

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 823606 cycles 567095 cycles 1.45
ML-DSA-65 sign 1542464 cycles 916167 cycles 1.68
ML-DSA-87 sign 2035242 cycles 1174073 cycles 1.73

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 138896 cycles 114477 cycles 1.21
ML-DSA-44 sign 662964 cycles 361237 cycles 1.84
ML-DSA-44 verify 142745 cycles 118256 cycles 1.21
ML-DSA-65 keypair 240339 cycles 197753 cycles 1.22
ML-DSA-65 sign 1318067 cycles 594473 cycles 2.22
ML-DSA-65 verify 237512 cycles 194861 cycles 1.22
ML-DSA-87 keypair 409214 cycles 324704 cycles 1.26
ML-DSA-87 sign 1770846 cycles 759517 cycles 2.33
ML-DSA-87 verify 405116 cycles 320974 cycles 1.26

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton2'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 138896 cycles 114477 cycles 1.21
ML-DSA-44 sign 662964 cycles 361237 cycles 1.84
ML-DSA-44 verify 142745 cycles 118256 cycles 1.21
ML-DSA-65 keypair 240339 cycles 197753 cycles 1.22
ML-DSA-65 sign 1318067 cycles 594473 cycles 2.22
ML-DSA-65 verify 237512 cycles 194861 cycles 1.22
ML-DSA-87 keypair 409214 cycles 324704 cycles 1.26
ML-DSA-87 sign 1770846 cycles 759517 cycles 2.33
ML-DSA-87 verify 405116 cycles 320974 cycles 1.26

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4 (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 128894 cycles 128710 cycles 1.00
ML-DSA-44 sign 687048 cycles 456492 cycles 1.51
ML-DSA-44 verify 136996 cycles 137036 cycles 1.00
ML-DSA-65 keypair 220690 cycles 221169 cycles 1.00
ML-DSA-65 sign 1298369 cycles 737894 cycles 1.76
ML-DSA-65 verify 220828 cycles 221482 cycles 1.00
ML-DSA-87 keypair 367518 cycles 365696 cycles 1.00
ML-DSA-87 sign 1723675 cycles 939482 cycles 1.83
ML-DSA-87 verify 376478 cycles 370312 cycles 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a) (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 120292 cycles 120111 cycles 1.00
ML-DSA-44 sign 663586 cycles 453486 cycles 1.46
ML-DSA-44 verify 128698 cycles 130798 cycles 0.98
ML-DSA-65 keypair 202045 cycles 204199 cycles 0.99
ML-DSA-65 sign 1236609 cycles 739361 cycles 1.67
ML-DSA-65 verify 208570 cycles 209674 cycles 0.99
ML-DSA-87 keypair 332281 cycles 337992 cycles 0.98
ML-DSA-87 sign 1604386 cycles 933153 cycles 1.72
ML-DSA-87 verify 342682 cycles 346690 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 687048 cycles 456492 cycles 1.51
ML-DSA-65 sign 1298369 cycles 737894 cycles 1.76
ML-DSA-87 sign 1723675 cycles 939482 cycles 1.83

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 663586 cycles 453486 cycles 1.46
ML-DSA-65 sign 1236609 cycles 739361 cycles 1.67
ML-DSA-87 sign 1604386 cycles 933153 cycles 1.72

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3 (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 138184 cycles 138861 cycles 1.00
ML-DSA-44 sign 742958 cycles 492727 cycles 1.51
ML-DSA-44 verify 147781 cycles 148599 cycles 0.99
ML-DSA-65 keypair 242901 cycles 242429 cycles 1.00
ML-DSA-65 sign 1414671 cycles 805213 cycles 1.76
ML-DSA-65 verify 239333 cycles 241126 cycles 0.99
ML-DSA-87 keypair 393136 cycles 397342 cycles 0.99
ML-DSA-87 sign 1851964 cycles 1027948 cycles 1.80
ML-DSA-87 verify 398847 cycles 402192 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 742958 cycles 492727 cycles 1.51
ML-DSA-65 sign 1414671 cycles 805213 cycles 1.76
ML-DSA-87 sign 1851964 cycles 1027948 cycles 1.80

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 265807 cycles 277313 cycles 0.96
ML-DSA-44 sign 1274279 cycles 828267 cycles 1.54
ML-DSA-44 verify 262520 cycles 274463 cycles 0.96
ML-DSA-65 keypair 451423 cycles 471060 cycles 0.96
ML-DSA-65 sign 2457606 cycles 1346017 cycles 1.83
ML-DSA-65 verify 429893 cycles 448760 cycles 0.96
ML-DSA-87 keypair 758358 cycles 801895 cycles 0.95
ML-DSA-87 sign 3298153 cycles 1809556 cycles 1.82
ML-DSA-87 verify 728789 cycles 770657 cycles 0.95

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 1274279 cycles 828267 cycles 1.54
ML-DSA-65 sign 2457606 cycles 1346017 cycles 1.83
ML-DSA-87 sign 3298153 cycles 1809556 cycles 1.82

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2 (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 214464 cycles 214662 cycles 1.00
ML-DSA-44 sign 1161571 cycles 783786 cycles 1.48
ML-DSA-44 verify 229571 cycles 230522 cycles 1.00
ML-DSA-65 keypair 381524 cycles 381415 cycles 1.00
ML-DSA-65 sign 2207162 cycles 1281921 cycles 1.72
ML-DSA-65 verify 371837 cycles 371438 cycles 1.00
ML-DSA-87 keypair 605148 cycles 606220 cycles 1.00
ML-DSA-87 sign 2882966 cycles 1619637 cycles 1.78
ML-DSA-87 verify 616524 cycles 618298 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton2 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 1161571 cycles 783786 cycles 1.48
ML-DSA-65 sign 2207162 cycles 1281921 cycles 1.72
ML-DSA-87 sign 2882966 cycles 1619637 cycles 1.78

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 312712 cycles 306686 cycles 1.02
ML-DSA-44 sign 1728925 cycles 1222232 cycles 1.41
ML-DSA-44 verify 343844 cycles 338964 cycles 1.01
ML-DSA-65 keypair 566122 cycles 567021 cycles 1.00
ML-DSA-65 sign 3225229 cycles 1997092 cycles 1.61
ML-DSA-65 verify 549061 cycles 541354 cycles 1.01
ML-DSA-87 keypair 860963 cycles 864387 cycles 1.00
ML-DSA-87 sign 4197803 cycles 2462154 cycles 1.70
ML-DSA-87 verify 863607 cycles 896795 cycles 0.96

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 1728925 cycles 1222232 cycles 1.41
ML-DSA-65 sign 3225229 cycles 1997092 cycles 1.61
ML-DSA-87 sign 4197803 cycles 2462154 cycles 1.70

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 459420 cycles 466151 cycles 0.99
ML-DSA-44 sign 2858462 cycles 2216816 cycles 1.29
ML-DSA-44 verify 541568 cycles 549170 cycles 0.99
ML-DSA-65 keypair 766136 cycles 782572 cycles 0.98
ML-DSA-65 sign 5185448 cycles 3596544 cycles 1.44
ML-DSA-65 verify 835981 cycles 850200 cycles 0.98
ML-DSA-87 keypair 1228094 cycles 1255621 cycles 0.98
ML-DSA-87 sign 6547438 cycles 4404988 cycles 1.49
ML-DSA-87 verify 1336342 cycles 1360710 cycles 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 2858462 cycles 2216816 cycles 1.29
ML-DSA-65 sign 5185448 cycles 3596544 cycles 1.44
ML-DSA-87 sign 6547438 cycles 4404988 cycles 1.49

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Details
Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 keypair 825918 cycles 828729 cycles 1.00
ML-DSA-44 sign 4705674 cycles 3340709 cycles 1.41
ML-DSA-44 verify 914019 cycles 921894 cycles 0.99
ML-DSA-65 keypair 1395196 cycles 1409639 cycles 0.99
ML-DSA-65 sign 8807723 cycles 5446481 cycles 1.62
ML-DSA-65 verify 1459996 cycles 1471016 cycles 0.99
ML-DSA-87 keypair 2296113 cycles 2316188 cycles 0.99
ML-DSA-87 sign 11328951 cycles 6818628 cycles 1.66
ML-DSA-87 verify 2382836 cycles 2408046 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4dfb1ea Previous: 9551965 Ratio
ML-DSA-44 sign 4705674 cycles 3340709 cycles 1.41
ML-DSA-65 sign 8807723 cycles 5446481 cycles 1.62
ML-DSA-87 sign 11328951 cycles 6818628 cycles 1.66

This comment was automatically generated by workflow using github-action-benchmark.

@hanno-becker
Copy link
Contributor Author

Summary of the impact of low RAM:

| Platform                  | Build  | Low RAM (cycles) | Perf (cycles) | Slowdown |
|:--------------------------|:-------|:----------------:|:-------------:|:--------:|
| Mac Mini M1               | opt    |          836,392 |       277,872 |    3.01× |
| Intel Xeon 4th gen (c7i)  | opt    |          807,607 |       232,753 |    3.47× |
| Intel Xeon 3rd gen (c6i)  | opt    |        1,280,913 |       351,393 |    3.65× |
| AMD EPYC 4th gen (c7a)    | opt    |          987,439 |       248,681 |    3.97× |
| AMD EPYC 3rd gen (c6a)    | opt    |        1,166,629 |       393,913 |    2.96× |
| Graviton4                 | opt    |        1,150,998 |       427,860 |    2.69× |
| Graviton3                 | opt    |        1,246,018 |       450,433 |    2.77× |
| Graviton2                 | opt    |        1,770,846 |       759,517 |    2.33× |
| Arm Cortex-A76 (RPi5)     | opt    |        1,770,450 |       758,586 |    2.33× |
| Arm Cortex-A72 (RPi4)     | opt    |        3,067,225 |     1,389,594 |    2.21× |
| Arm Cortex-A55 (SD888)    | opt    |        3,298,153 |     1,809,556 |    1.82× |
| Mac Mini M1               | no-opt |        1,522,919 |       879,234 |    1.73× |
| Intel Xeon 4th gen (c7i)  | no-opt |        1,239,669 |       712,093 |    1.74× |
| Intel Xeon 3rd gen (c6i)  | no-opt |        2,035,242 |     1,174,073 |    1.73× |
| AMD EPYC 4th gen (c7a)    | no-opt |        1,604,386 |       933,153 |    1.72× |
| AMD EPYC 3rd gen (c6a)    | no-opt |        1,810,664 |     1,087,295 |    1.67× |
| Graviton4                 | no-opt |        1,723,675 |       939,482 |    1.83× |
| Graviton3                 | no-opt |        1,851,964 |     1,027,948 |    1.80× |
| Graviton2                 | no-opt |        2,882,966 |     1,619,637 |    1.78× |
| Arm Cortex-A76 (RPi5)     | no-opt |        2,882,623 |     1,616,853 |    1.78× |
| Arm Cortex-A72 (RPi4)     | no-opt |        4,197,803 |     2,462,154 |    1.70× |
| Arm Cortex-A55 (SD888)    | no-opt |        6,547,438 |     4,404,988 |    1.49× |
| SpacemiT K1 8 (BPi F3)    | no-opt |       11,328,951 |     6,818,628 |    1.66× |

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants