Skip to content

Conversation

@mkannwischer
Copy link
Contributor

No description provided.

Signed-off-by: Matthias J. Kannwischer <matthias@kannwischer.eu>
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 46494 cycles 46491 cycles 1.00
ML-DSA-44 sign 132762 cycles 132756 cycles 1.00
ML-DSA-44 verify 47840 cycles 47840 cycles 1
ML-DSA-65 keypair 81465 cycles 81459 cycles 1.00
ML-DSA-65 sign 219248 cycles 219227 cycles 1.00
ML-DSA-65 verify 80109 cycles 80113 cycles 1.00
ML-DSA-87 keypair 132635 cycles 132614 cycles 1.00
ML-DSA-87 sign 281084 cycles 281122 cycles 1.00
ML-DSA-87 verify 130372 cycles 130374 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 115237 cycles 115273 cycles 1.00
ML-DSA-44 sign 427065 cycles 430316 cycles 0.99
ML-DSA-44 verify 121775 cycles 122151 cycles 1.00
ML-DSA-65 keypair 197172 cycles 197233 cycles 1.00
ML-DSA-65 sign 694389 cycles 700330 cycles 0.99
ML-DSA-65 verify 197064 cycles 197633 cycles 1.00
ML-DSA-87 keypair 325229 cycles 325248 cycles 1.00
ML-DSA-87 sign 877177 cycles 883802 cycles 0.99
ML-DSA-87 verify 327937 cycles 328608 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 35555 cycles 35274 cycles 1.01
ML-DSA-44 sign 120751 cycles 120596 cycles 1.00
ML-DSA-44 verify 38106 cycles 38112 cycles 1.00
ML-DSA-65 keypair 61806 cycles 62385 cycles 0.99
ML-DSA-65 sign 199792 cycles 200761 cycles 1.00
ML-DSA-65 verify 62477 cycles 62338 cycles 1.00
ML-DSA-87 keypair 95115 cycles 95246 cycles 1.00
ML-DSA-87 sign 235237 cycles 235742 cycles 1.00
ML-DSA-87 verify 93979 cycles 94485 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i) (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 95141 cycles 95224 cycles 1.00
ML-DSA-44 sign 344739 cycles 347931 cycles 0.99
ML-DSA-44 verify 100196 cycles 100532 cycles 1.00
ML-DSA-65 keypair 164035 cycles 163969 cycles 1.00
ML-DSA-65 sign 560186 cycles 566227 cycles 0.99
ML-DSA-65 verify 164111 cycles 165081 cycles 0.99
ML-DSA-87 keypair 268937 cycles 267897 cycles 1.00
ML-DSA-87 sign 713736 cycles 720989 cycles 0.99
ML-DSA-87 verify 271312 cycles 271111 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 69317 cycles 69480 cycles 1.00
ML-DSA-44 sign 185268 cycles 184482 cycles 1.00
ML-DSA-44 verify 68857 cycles 68853 cycles 1.00
ML-DSA-65 keypair 119601 cycles 119973 cycles 1.00
ML-DSA-65 sign 294881 cycles 295604 cycles 1.00
ML-DSA-65 verify 115238 cycles 115730 cycles 1.00
ML-DSA-87 keypair 202046 cycles 202007 cycles 1.00
ML-DSA-87 sign 385372 cycles 385433 cycles 1.00
ML-DSA-87 verify 193423 cycles 193033 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 69675 cycles 69575 cycles 1.00
ML-DSA-44 sign 213813 cycles 213862 cycles 1.00
ML-DSA-44 verify 72503 cycles 72738 cycles 1.00
ML-DSA-65 keypair 122963 cycles 122984 cycles 1.00
ML-DSA-65 sign 350018 cycles 350224 cycles 1.00
ML-DSA-65 verify 120182 cycles 120261 cycles 1.00
ML-DSA-87 keypair 201218 cycles 201149 cycles 1.00
ML-DSA-87 sign 449654 cycles 449287 cycles 1.00
ML-DSA-87 verify 198037 cycles 198561 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 57348 cycles 57265 cycles 1.00
ML-DSA-44 sign 179627 cycles 179390 cycles 1.00
ML-DSA-44 verify 60937 cycles 61078 cycles 1.00
ML-DSA-65 keypair 99932 cycles 99939 cycles 1.00
ML-DSA-65 sign 296116 cycles 296077 cycles 1.00
ML-DSA-65 verify 100045 cycles 99739 cycles 1.00
ML-DSA-87 keypair 153919 cycles 153935 cycles 1.00
ML-DSA-87 sign 352410 cycles 352557 cycles 1.00
ML-DSA-87 verify 153125 cycles 151735 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 116054 cycles 116119 cycles 1.00
ML-DSA-44 sign 377999 cycles 378412 cycles 1.00
ML-DSA-44 verify 120779 cycles 120766 cycles 1.00
ML-DSA-65 keypair 200530 cycles 200558 cycles 1.00
ML-DSA-65 sign 624366 cycles 623514 cycles 1.00
ML-DSA-65 verify 198455 cycles 198601 cycles 1.00
ML-DSA-87 keypair 327624 cycles 328080 cycles 1.00
ML-DSA-87 sign 789953 cycles 792991 cycles 1.00
ML-DSA-87 verify 325780 cycles 325370 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a) (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 135114 cycles 134934 cycles 1.00
ML-DSA-44 sign 540722 cycles 539920 cycles 1.00
ML-DSA-44 verify 147809 cycles 147971 cycles 1.00
ML-DSA-65 keypair 228194 cycles 229010 cycles 1.00
ML-DSA-65 sign 890648 cycles 890245 cycles 1.00
ML-DSA-65 verify 237813 cycles 238167 cycles 1.00
ML-DSA-87 keypair 372736 cycles 372838 cycles 1.00
ML-DSA-87 sign 1105006 cycles 1105377 cycles 1.00
ML-DSA-87 verify 386359 cycles 386766 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4 (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 128380 cycles 128267 cycles 1.00
ML-DSA-44 sign 453485 cycles 456418 cycles 0.99
ML-DSA-44 verify 135873 cycles 136416 cycles 1.00
ML-DSA-65 keypair 220649 cycles 220516 cycles 1.00
ML-DSA-65 sign 740468 cycles 746247 cycles 0.99
ML-DSA-65 verify 219813 cycles 220295 cycles 1.00
ML-DSA-87 keypair 365420 cycles 365299 cycles 1.00
ML-DSA-87 sign 937248 cycles 943647 cycles 0.99
ML-DSA-87 verify 368255 cycles 369175 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 74090 cycles 74104 cycles 1.00
ML-DSA-44 sign 228617 cycles 228552 cycles 1.00
ML-DSA-44 verify 78072 cycles 78146 cycles 1.00
ML-DSA-65 keypair 130667 cycles 130711 cycles 1.00
ML-DSA-65 sign 378956 cycles 378920 cycles 1.00
ML-DSA-65 verify 129548 cycles 129299 cycles 1.00
ML-DSA-87 keypair 209526 cycles 212097 cycles 0.99
ML-DSA-87 sign 475453 cycles 479650 cycles 0.99
ML-DSA-87 verify 210393 cycles 208789 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 41702 cycles 42000 cycles 0.99
ML-DSA-44 sign 130927 cycles 130574 cycles 1.00
ML-DSA-44 verify 44380 cycles 44264 cycles 1.00
ML-DSA-65 keypair 72404 cycles 72987 cycles 0.99
ML-DSA-65 sign 210959 cycles 216887 cycles 0.97
ML-DSA-65 verify 72929 cycles 75106 cycles 0.97
ML-DSA-87 keypair 110791 cycles 110314 cycles 1.00
ML-DSA-87 sign 249188 cycles 248682 cycles 1.00
ML-DSA-87 verify 110380 cycles 110500 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i) (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 158062 cycles 160167 cycles 0.99
ML-DSA-44 sign 562310 cycles 572031 cycles 0.98
ML-DSA-44 verify 168875 cycles 171645 cycles 0.98
ML-DSA-65 keypair 270449 cycles 270147 cycles 1.00
ML-DSA-65 sign 921528 cycles 926805 cycles 0.99
ML-DSA-65 verify 274668 cycles 276641 cycles 0.99
ML-DSA-87 keypair 451229 cycles 451733 cycles 1.00
ML-DSA-87 sign 1174286 cycles 1184256 cycles 0.99
ML-DSA-87 verify 458252 cycles 460254 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2 (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 214373 cycles 214510 cycles 1.00
ML-DSA-44 sign 778280 cycles 782566 cycles 0.99
ML-DSA-44 verify 229891 cycles 230017 cycles 1.00
ML-DSA-65 keypair 386078 cycles 385274 cycles 1.00
ML-DSA-65 sign 1301070 cycles 1310324 cycles 0.99
ML-DSA-65 verify 375133 cycles 376254 cycles 1.00
ML-DSA-87 keypair 606591 cycles 607167 cycles 1.00
ML-DSA-87 sign 1618026 cycles 1625355 cycles 1.00
ML-DSA-87 verify 617929 cycles 616911 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3 (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 138891 cycles 138830 cycles 1.00
ML-DSA-44 sign 490737 cycles 492916 cycles 1.00
ML-DSA-44 verify 147868 cycles 148615 cycles 0.99
ML-DSA-65 keypair 242456 cycles 242682 cycles 1.00
ML-DSA-65 sign 804388 cycles 809104 cycles 0.99
ML-DSA-65 verify 240059 cycles 240471 cycles 1.00
ML-DSA-87 keypair 396897 cycles 396818 cycles 1.00
ML-DSA-87 sign 1021280 cycles 1026889 cycles 0.99
ML-DSA-87 verify 400405 cycles 401650 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a) (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 120565 cycles 120842 cycles 1.00
ML-DSA-44 sign 454552 cycles 454589 cycles 1.00
ML-DSA-44 verify 130212 cycles 129982 cycles 1.00
ML-DSA-65 keypair 205425 cycles 206483 cycles 0.99
ML-DSA-65 sign 738328 cycles 738534 cycles 1.00
ML-DSA-65 verify 210215 cycles 210147 cycles 1.00
ML-DSA-87 keypair 338283 cycles 338087 cycles 1.00
ML-DSA-87 sign 921706 cycles 928923 cycles 0.99
ML-DSA-87 verify 345356 cycles 345735 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 828540 cycles 828120 cycles 1.00
ML-DSA-44 sign 3329343 cycles 3336672 cycles 1.00
ML-DSA-44 verify 917656 cycles 919042 cycles 1.00
ML-DSA-65 keypair 1403018 cycles 1401756 cycles 1.00
ML-DSA-65 sign 5428230 cycles 5455432 cycles 1.00
ML-DSA-65 verify 1468634 cycles 1469025 cycles 1.00
ML-DSA-87 keypair 2305597 cycles 2305185 cycles 1.00
ML-DSA-87 sign 6804775 cycles 6819110 cycles 1.00
ML-DSA-87 verify 2402428 cycles 2394628 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Benchmark suite Current: 8120a06 Previous: b6269a2 Ratio
ML-DSA-44 keypair 225629 cycles 240829 cycles 0.94
ML-DSA-44 sign 680394 cycles 683095 cycles 1.00
ML-DSA-44 verify 229594 cycles 226158 cycles 1.02
ML-DSA-65 keypair 421929 cycles 406927 cycles 1.04
ML-DSA-65 sign 1119340 cycles 1132727 cycles 0.99
ML-DSA-65 verify 394447 cycles 394798 cycles 1.00
ML-DSA-87 keypair 665880 cycles 671057 cycles 0.99
ML-DSA-87 sign 1490087 cycles 1465367 cycles 1.02
ML-DSA-87 verify 659414 cycles 650701 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 8120a06 Previous: b6269a2 Ratio
ML-DSA-65 keypair 421929 cycles 406927 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 285404 cycles 291889 cycles 0.98
ML-DSA-44 sign 920060 cycles 942126 cycles 0.98
ML-DSA-44 verify 289804 cycles 291808 cycles 0.99
ML-DSA-65 keypair 485651 cycles 491020 cycles 0.99
ML-DSA-65 sign 1515621 cycles 1528633 cycles 0.99
ML-DSA-65 verify 472980 cycles 480273 cycles 0.98
ML-DSA-87 keypair 823654 cycles 844926 cycles 0.97
ML-DSA-87 sign 1997630 cycles 2096299 cycles 0.95
ML-DSA-87 verify 802437 cycles 819800 cycles 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Benchmark suite Current: 8120a06 Previous: b6269a2 Ratio
ML-DSA-44 keypair 311275 cycles 320285 cycles 0.97
ML-DSA-44 sign 1177175 cycles 1211423 cycles 0.97
ML-DSA-44 verify 343489 cycles 339411 cycles 1.01
ML-DSA-65 keypair 582708 cycles 571992 cycles 1.02
ML-DSA-65 sign 1986292 cycles 1995046 cycles 1.00
ML-DSA-65 verify 557254 cycles 542504 cycles 1.03
ML-DSA-87 keypair 887287 cycles 890645 cycles 1.00
ML-DSA-87 sign 2495395 cycles 2467520 cycles 1.01
ML-DSA-87 verify 894643 cycles 902231 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 464358 cycles 464358 cycles 1
ML-DSA-44 sign 2209996 cycles 2207943 cycles 1.00
ML-DSA-44 verify 544819 cycles 544948 cycles 1.00
ML-DSA-65 keypair 778741 cycles 777653 cycles 1.00
ML-DSA-65 sign 3626474 cycles 3619429 cycles 1.00
ML-DSA-65 verify 847027 cycles 847031 cycles 1.00
ML-DSA-87 keypair 1255026 cycles 1256120 cycles 1.00
ML-DSA-87 sign 4474904 cycles 4460956 cycles 1.00
ML-DSA-87 verify 1358544 cycles 1361164 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 115605 cycles 115652 cycles 1.00
ML-DSA-44 sign 377471 cycles 377523 cycles 1.00
ML-DSA-44 verify 120386 cycles 120369 cycles 1.00
ML-DSA-65 keypair 200211 cycles 200101 cycles 1.00
ML-DSA-65 sign 624218 cycles 622879 cycles 1.00
ML-DSA-65 verify 198004 cycles 198344 cycles 1.00
ML-DSA-87 keypair 327021 cycles 327210 cycles 1.00
ML-DSA-87 sign 788775 cycles 791280 cycles 1.00
ML-DSA-87 verify 325199 cycles 324852 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)

Benchmark suite Current: 8120a06 Previous: 257e8f8 Ratio
ML-DSA-44 keypair 213752 cycles 214028 cycles 1.00
ML-DSA-44 sign 776794 cycles 781614 cycles 0.99
ML-DSA-44 verify 229331 cycles 229651 cycles 1.00
ML-DSA-65 keypair 384888 cycles 384785 cycles 1.00
ML-DSA-65 sign 1307395 cycles 1323250 cycles 0.99
ML-DSA-65 verify 374071 cycles 375846 cycles 1.00
ML-DSA-87 keypair 606284 cycles 606382 cycles 1.00
ML-DSA-87 sign 1614270 cycles 1622759 cycles 0.99
ML-DSA-87 verify 617645 cycles 616616 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants