Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

deps: upgrade vitest #6237

Merged
merged 5 commits into from
Dec 25, 2023
Merged

deps: upgrade vitest #6237

merged 5 commits into from
Dec 25, 2023

Conversation

nazarhussain
Copy link
Contributor

Motivation
Make tests more stable.

Description

Upgrade vitest.

Steps to test or reproduce

  • Run all tests

@nazarhussain nazarhussain requested a review from a team as a code owner December 25, 2023 15:02
@nazarhussain nazarhussain self-assigned this Dec 25, 2023
@codecov Codecov
Copy link

codecov bot commented Dec 25, 2023 •
edited
Loading

Codecov Report

Merging #6237 (6d5f06e) into unstable (592c147) will increase coverage by 0.01%.
Report is 1 commits behind head on unstable.
The diff coverage is n/a.

Additional details and impacted files 
@@             Coverage Diff              @@
##           unstable    #6237      +/-   ##
============================================
+ Coverage     80.95%   80.97%   +0.01%     
============================================
  Files           185      185              
  Lines         17935    17935              
  Branches       1078     1078              
============================================
+ Hits          14519    14522       +3     
+ Misses         3389     3386       -3     
  Partials         27       27

@nazarhussain nazarhussain changed the title deps: Upgrade vitest deps: upgrade vitest Dec 25, 2023
@github-actions GitHub Actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 38f4237 Previous: 592c147 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 583.42 us/op 907.02 us/op 0.64
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 113.57 us/op 49.748 us/op 2.28
BLS verify - blst-native 1.3715 ms/op 1.0506 ms/op 1.31
BLS verifyMultipleSignatures 3 - blst-native 2.9516 ms/op 2.2425 ms/op 1.32
BLS verifyMultipleSignatures 8 - blst-native 6.8103 ms/op 4.9645 ms/op 1.37
BLS verifyMultipleSignatures 32 - blst-native 23.794 ms/op 18.247 ms/op 1.30
BLS verifyMultipleSignatures 64 - blst-native 44.888 ms/op 35.953 ms/op 1.25
BLS verifyMultipleSignatures 128 - blst-native 89.659 ms/op 71.369 ms/op 1.26
BLS deserializing 10000 signatures 975.43 ms/op 787.65 ms/op 1.24
BLS deserializing 100000 signatures 9.2080 s/op 8.0244 s/op 1.15
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3689 ms/op 1.1342 ms/op 1.21
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5863 ms/op 1.2849 ms/op 1.23
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.4337 ms/op 2.0209 ms/op 1.20
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.5398 ms/op 3.8664 ms/op 0.92
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.7638 ms/op 4.7827 ms/op 1.21
BLS aggregatePubkeys 32 - blst-native 26.636 us/op 21.803 us/op 1.22
BLS aggregatePubkeys 128 - blst-native 101.98 us/op 84.720 us/op 1.20
getAttestationsForBlock 63.702 ms/op 35.122 ms/op 1.81
getSlashingsAndExits - default max 262.82 us/op 92.657 us/op 2.84
getSlashingsAndExits - 2k 521.02 us/op 297.23 us/op 1.75
proposeBlockBody type=full, size=empty 6.0688 ms/op 3.8611 ms/op 1.57
isKnown best case - 1 super set check 376.00 ns/op 324.00 ns/op 1.16
isKnown normal case - 2 super set checks 452.00 ns/op 336.00 ns/op 1.35
isKnown worse case - 16 super set checks 465.00 ns/op 356.00 ns/op 1.31
CheckpointStateCache - add get delete 5.9500 us/op 3.6510 us/op 1.63
validate api signedAggregateAndProof - struct 2.8637 ms/op 2.3322 ms/op 1.23
validate gossip signedAggregateAndProof - struct 2.8400 ms/op 2.3889 ms/op 1.19
validate gossip attestation - vc 640000 1.4258 ms/op 1.1377 ms/op 1.25
batch validate gossip attestation - vc 640000 - chunk 32 172.13 us/op 132.73 us/op 1.30
batch validate gossip attestation - vc 640000 - chunk 64 152.08 us/op 118.81 us/op 1.28
batch validate gossip attestation - vc 640000 - chunk 128 149.77 us/op 113.37 us/op 1.32
batch validate gossip attestation - vc 640000 - chunk 256 138.13 us/op 108.21 us/op 1.28
pickEth1Vote - no votes 1.3820 ms/op 928.88 us/op 1.49
pickEth1Vote - max votes 10.086 ms/op 8.9913 ms/op 1.12
pickEth1Vote - Eth1Data hashTreeRoot value x2048 18.728 ms/op 21.102 ms/op 0.89
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 26.138 ms/op 28.910 ms/op 0.90
pickEth1Vote - Eth1Data fastSerialize value x2048 682.55 us/op 431.60 us/op 1.58
pickEth1Vote - Eth1Data fastSerialize tree x2048 5.3611 ms/op 7.3803 ms/op 0.73
bytes32 toHexString 649.00 ns/op 432.00 ns/op 1.50
bytes32 Buffer.toString(hex) 305.00 ns/op 300.00 ns/op 1.02
bytes32 Buffer.toString(hex) from Uint8Array 517.00 ns/op 418.00 ns/op 1.24
bytes32 Buffer.toString(hex) + 0x 310.00 ns/op 301.00 ns/op 1.03
Object access 1 prop 0.17600 ns/op 0.18600 ns/op 0.95
Map access 1 prop 0.14400 ns/op 0.17600 ns/op 0.82
Object get x1000 7.0890 ns/op 4.7410 ns/op 1.50
Map get x1000 1.0300 ns/op 0.69100 ns/op 1.49
Object set x1000 60.108 ns/op 25.133 ns/op 2.39
Map set x1000 42.855 ns/op 17.015 ns/op 2.52
Return object 10000 times 0.24940 ns/op 0.21230 ns/op 1.17
Throw Error 10000 times 4.0046 us/op 2.6206 us/op 1.53
fastMsgIdFn sha256 / 200 bytes 3.4300 us/op 1.8310 us/op 1.87
fastMsgIdFn h32 xxhash / 200 bytes 331.00 ns/op 278.00 ns/op 1.19
fastMsgIdFn h64 xxhash / 200 bytes 368.00 ns/op 347.00 ns/op 1.06
fastMsgIdFn sha256 / 1000 bytes 11.614 us/op 5.9010 us/op 1.97
fastMsgIdFn h32 xxhash / 1000 bytes 460.00 ns/op 390.00 ns/op 1.18
fastMsgIdFn h64 xxhash / 1000 bytes 433.00 ns/op 407.00 ns/op 1.06
fastMsgIdFn sha256 / 10000 bytes 103.82 us/op 49.835 us/op 2.08
fastMsgIdFn h32 xxhash / 10000 bytes 2.0250 us/op 1.6950 us/op 1.19
fastMsgIdFn h64 xxhash / 10000 bytes 1.3870 us/op 1.1640 us/op 1.19
send data - 1000 256B messages 20.223 ms/op 12.698 ms/op 1.59
send data - 1000 512B messages 28.122 ms/op 15.088 ms/op 1.86
send data - 1000 1024B messages 43.472 ms/op 22.395 ms/op 1.94
send data - 1000 1200B messages 40.536 ms/op 28.314 ms/op 1.43
send data - 1000 2048B messages 46.860 ms/op 33.459 ms/op 1.40
send data - 1000 4096B messages 44.949 ms/op 30.064 ms/op 1.50
send data - 1000 16384B messages 124.15 ms/op 91.277 ms/op 1.36
send data - 1000 65536B messages 468.75 ms/op 434.23 ms/op 1.08
enrSubnets - fastDeserialize 64 bits 1.2610 us/op 914.00 ns/op 1.38
enrSubnets - ssz BitVector 64 bits 435.00 ns/op 417.00 ns/op 1.04
enrSubnets - fastDeserialize 4 bits 175.00 ns/op 195.00 ns/op 0.90
enrSubnets - ssz BitVector 4 bits 480.00 ns/op 417.00 ns/op 1.15
prioritizePeers score -10:0 att 32-0.1 sync 2-0 111.84 us/op 86.072 us/op 1.30
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 142.14 us/op 83.762 us/op 1.70
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 178.60 us/op 110.26 us/op 1.62
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 343.67 us/op 196.54 us/op 1.75
prioritizePeers score 0:0 att 64-1 sync 4-1 376.58 us/op 213.95 us/op 1.76
array of 16000 items push then shift 1.6665 us/op 1.2363 us/op 1.35
LinkedList of 16000 items push then shift 9.0850 ns/op 6.6490 ns/op 1.37
array of 16000 items push then pop 108.08 ns/op 60.947 ns/op 1.77
LinkedList of 16000 items push then pop 8.8020 ns/op 5.5550 ns/op 1.58
array of 24000 items push then shift 2.5079 us/op 1.7899 us/op 1.40
LinkedList of 24000 items push then shift 9.0430 ns/op 6.1690 ns/op 1.47
array of 24000 items push then pop 142.76 ns/op 87.948 ns/op 1.62
LinkedList of 24000 items push then pop 8.6510 ns/op 5.5090 ns/op 1.57
intersect bitArray bitLen 8 6.3890 ns/op 4.6060 ns/op 1.39
intersect array and set length 8 63.308 ns/op 46.786 ns/op 1.35
intersect bitArray bitLen 128 33.756 ns/op 26.241 ns/op 1.29
intersect array and set length 128 879.45 ns/op 676.42 ns/op 1.30
bitArray.getTrueBitIndexes() bitLen 128 1.5170 us/op 1.1840 us/op 1.28
bitArray.getTrueBitIndexes() bitLen 248 2.6640 us/op 1.9530 us/op 1.36
bitArray.getTrueBitIndexes() bitLen 512 4.9920 us/op 3.7820 us/op 1.32
Buffer.concat 32 items 909.00 ns/op 942.00 ns/op 0.96
Uint8Array.set 32 items 1.7270 us/op 1.8590 us/op 0.93
Set add up to 64 items then delete first 4.8693 us/op 1.6606 us/op 2.93
OrderedSet add up to 64 items then delete first 6.2963 us/op 2.4917 us/op 2.53
Set add up to 64 items then delete last 5.0043 us/op 1.8652 us/op 2.68
OrderedSet add up to 64 items then delete last 6.8950 us/op 2.7697 us/op 2.49
Set add up to 64 items then delete middle 4.9108 us/op 1.8235 us/op 2.69
OrderedSet add up to 64 items then delete middle 7.4180 us/op 3.8760 us/op 1.91
Set add up to 128 items then delete first 9.8393 us/op 3.6117 us/op 2.72
OrderedSet add up to 128 items then delete first 12.698 us/op 5.6915 us/op 2.23
Set add up to 128 items then delete last 9.4779 us/op 3.4862 us/op 2.72
OrderedSet add up to 128 items then delete last 12.031 us/op 5.2551 us/op 2.29
Set add up to 128 items then delete middle 10.115 us/op 3.4628 us/op 2.92
OrderedSet add up to 128 items then delete middle 17.565 us/op 10.009 us/op 1.75
Set add up to 256 items then delete first 21.151 us/op 7.1028 us/op 2.98
OrderedSet add up to 256 items then delete first 26.102 us/op 11.743 us/op 2.22
Set add up to 256 items then delete last 18.695 us/op 7.0369 us/op 2.66
OrderedSet add up to 256 items then delete last 24.240 us/op 10.858 us/op 2.23
Set add up to 256 items then delete middle 19.044 us/op 6.9565 us/op 2.74
OrderedSet add up to 256 items then delete middle 46.635 us/op 32.881 us/op 1.42
transfer serialized Status (84 B) 1.7220 us/op 1.3690 us/op 1.26
copy serialized Status (84 B) 1.4930 us/op 1.3600 us/op 1.10
transfer serialized SignedVoluntaryExit (112 B) 1.8250 us/op 1.7630 us/op 1.04
copy serialized SignedVoluntaryExit (112 B) 1.6220 us/op 1.5190 us/op 1.07
transfer serialized ProposerSlashing (416 B) 2.0410 us/op 2.7530 us/op 0.74
copy serialized ProposerSlashing (416 B) 2.2100 us/op 2.9360 us/op 0.75
transfer serialized Attestation (485 B) 2.2670 us/op 2.4270 us/op 0.93
copy serialized Attestation (485 B) 2.1910 us/op 2.5710 us/op 0.85
transfer serialized AttesterSlashing (33232 B) 2.3870 us/op 2.4120 us/op 0.99
copy serialized AttesterSlashing (33232 B) 6.0980 us/op 4.6730 us/op 1.30
transfer serialized Small SignedBeaconBlock (128000 B) 2.7520 us/op 3.1210 us/op 0.88
copy serialized Small SignedBeaconBlock (128000 B) 15.195 us/op 9.2370 us/op 1.65
transfer serialized Avg SignedBeaconBlock (200000 B) 3.0960 us/op 2.5030 us/op 1.24
copy serialized Avg SignedBeaconBlock (200000 B) 27.295 us/op 13.107 us/op 2.08
transfer serialized BlobsSidecar (524380 B) 3.3320 us/op 2.9100 us/op 1.15
copy serialized BlobsSidecar (524380 B) 95.256 us/op 74.740 us/op 1.27
transfer serialized Big SignedBeaconBlock (1000000 B) 3.8280 us/op 3.2290 us/op 1.19
copy serialized Big SignedBeaconBlock (1000000 B) 183.35 us/op 161.18 us/op 1.14
pass gossip attestations to forkchoice per slot 3.9198 ms/op 2.7191 ms/op 1.44
forkChoice updateHead vc 100000 bc 64 eq 0 681.64 us/op 516.77 us/op 1.32
forkChoice updateHead vc 600000 bc 64 eq 0 5.5347 ms/op 2.5958 ms/op 2.13
forkChoice updateHead vc 1000000 bc 64 eq 0 7.0202 ms/op 4.4349 ms/op 1.58
forkChoice updateHead vc 600000 bc 320 eq 0 4.2235 ms/op 2.5843 ms/op 1.63
forkChoice updateHead vc 600000 bc 1200 eq 0 4.3612 ms/op 2.6518 ms/op 1.64
forkChoice updateHead vc 600000 bc 7200 eq 0 5.2977 ms/op 3.2864 ms/op 1.61
forkChoice updateHead vc 600000 bc 64 eq 1000 11.344 ms/op 9.4540 ms/op 1.20
forkChoice updateHead vc 600000 bc 64 eq 10000 11.922 ms/op 9.7975 ms/op 1.22
forkChoice updateHead vc 600000 bc 64 eq 300000 15.954 ms/op 11.592 ms/op 1.38
computeDeltas 500000 validators 300 proto nodes 6.8279 ms/op 2.9815 ms/op 2.29
computeDeltas 500000 validators 1200 proto nodes 6.7511 ms/op 2.8968 ms/op 2.33
computeDeltas 500000 validators 7200 proto nodes 6.4089 ms/op 2.8940 ms/op 2.21
computeDeltas 750000 validators 300 proto nodes 9.5068 ms/op 4.4529 ms/op 2.13
computeDeltas 750000 validators 1200 proto nodes 9.7153 ms/op 4.4744 ms/op 2.17
computeDeltas 750000 validators 7200 proto nodes 9.4797 ms/op 4.4220 ms/op 2.14
computeDeltas 1400000 validators 300 proto nodes 18.320 ms/op 8.5677 ms/op 2.14
computeDeltas 1400000 validators 1200 proto nodes 18.762 ms/op 8.5956 ms/op 2.18
computeDeltas 1400000 validators 7200 proto nodes 18.817 ms/op 8.5750 ms/op 2.19
computeDeltas 2100000 validators 300 proto nodes 27.795 ms/op 12.945 ms/op 2.15
computeDeltas 2100000 validators 1200 proto nodes 27.742 ms/op 13.205 ms/op 2.10
computeDeltas 2100000 validators 7200 proto nodes 27.828 ms/op 13.107 ms/op 2.12
computeProposerBoostScoreFromBalances 500000 validators 3.7054 ms/op 3.2951 ms/op 1.12
computeProposerBoostScoreFromBalances 750000 validators 3.6064 ms/op 3.0830 ms/op 1.17
computeProposerBoostScoreFromBalances 1400000 validators 3.5882 ms/op 3.1155 ms/op 1.15
computeProposerBoostScoreFromBalances 2100000 validators 3.6111 ms/op 3.1300 ms/op 1.15
altair processAttestation - 250000 vs - 7PWei normalcase 2.2425 ms/op 1.4480 ms/op 1.55
altair processAttestation - 250000 vs - 7PWei worstcase 3.2774 ms/op 2.2185 ms/op 1.48
altair processAttestation - setStatus - 1/6 committees join 143.12 us/op 74.151 us/op 1.93
altair processAttestation - setStatus - 1/3 committees join 284.11 us/op 134.65 us/op 2.11
altair processAttestation - setStatus - 1/2 committees join 361.39 us/op 194.80 us/op 1.86
altair processAttestation - setStatus - 2/3 committees join 473.20 us/op 255.19 us/op 1.85
altair processAttestation - setStatus - 4/5 committees join 635.86 us/op 377.53 us/op 1.68
altair processAttestation - setStatus - 100% committees join 764.08 us/op 478.52 us/op 1.60
altair processBlock - 250000 vs - 7PWei normalcase 9.4466 ms/op 9.0862 ms/op 1.04
altair processBlock - 250000 vs - 7PWei normalcase hashState 38.453 ms/op 31.901 ms/op 1.21
altair processBlock - 250000 vs - 7PWei worstcase 37.402 ms/op 32.970 ms/op 1.13
altair processBlock - 250000 vs - 7PWei worstcase hashState 90.558 ms/op 77.738 ms/op 1.16
phase0 processBlock - 250000 vs - 7PWei normalcase 2.5617 ms/op 2.6466 ms/op 0.97
phase0 processBlock - 250000 vs - 7PWei worstcase 29.990 ms/op 25.212 ms/op 1.19
altair processEth1Data - 250000 vs - 7PWei normalcase 557.64 us/op 293.45 us/op 1.90
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 10.716 us/op 12.191 us/op 0.88
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 68.852 us/op 65.322 us/op 1.05
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 15.858 us/op 9.4610 us/op 1.68
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 10.127 us/op 5.0970 us/op 1.99
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 183.22 us/op 92.489 us/op 1.98
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.3392 ms/op 1.1565 ms/op 1.16
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.5034 ms/op 1.2487 ms/op 1.20
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.9031 ms/op 973.66 us/op 1.95
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.6760 ms/op 2.7283 ms/op 1.35
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.6241 ms/op 1.4546 ms/op 1.80
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.5909 ms/op 3.8200 ms/op 1.46
Tree 40 250000 create 414.48 ms/op 255.33 ms/op 1.62
Tree 40 250000 get(125000) 216.36 ns/op 101.27 ns/op 2.14
Tree 40 250000 set(125000) 1.1853 us/op 778.05 ns/op 1.52
Tree 40 250000 toArray() 23.038 ms/op 16.079 ms/op 1.43
Tree 40 250000 iterate all - toArray() + loop 23.088 ms/op 17.400 ms/op 1.33
Tree 40 250000 iterate all - get(i) 76.426 ms/op 44.917 ms/op 1.70
MutableVector 250000 create 15.717 ms/op 9.0659 ms/op 1.73
MutableVector 250000 get(125000) 6.3050 ns/op 5.3240 ns/op 1.18
MutableVector 250000 set(125000) 261.24 ns/op 191.32 ns/op 1.37
MutableVector 250000 toArray() 3.3353 ms/op 2.3283 ms/op 1.43
MutableVector 250000 iterate all - toArray() + loop 3.7728 ms/op 2.4078 ms/op 1.57
MutableVector 250000 iterate all - get(i) 1.5370 ms/op 1.3307 ms/op 1.16
Array 250000 create 2.5434 ms/op 2.1078 ms/op 1.21
Array 250000 clone - spread 1.2572 ms/op 1.0841 ms/op 1.16
Array 250000 get(125000) 1.0300 ns/op 1.0160 ns/op 1.01
Array 250000 set(125000) 4.2330 ns/op 1.2190 ns/op 3.47
Array 250000 iterate all - loop 165.89 us/op 153.15 us/op 1.08
effectiveBalanceIncrements clone Uint8Array 300000 30.092 us/op 13.355 us/op 2.25
effectiveBalanceIncrements clone MutableVector 300000 355.00 ns/op 398.00 ns/op 0.89
effectiveBalanceIncrements rw all Uint8Array 300000 199.89 us/op 182.93 us/op 1.09
effectiveBalanceIncrements rw all MutableVector 300000 86.879 ms/op 64.071 ms/op 1.36
phase0 afterProcessEpoch - 250000 vs - 7PWei 114.27 ms/op 73.057 ms/op 1.56
phase0 beforeProcessEpoch - 250000 vs - 7PWei 52.974 ms/op 43.696 ms/op 1.21
altair processEpoch - mainnet_e81889 512.68 ms/op 411.80 ms/op 1.24
mainnet_e81889 - altair beforeProcessEpoch 86.298 ms/op 65.525 ms/op 1.32
mainnet_e81889 - altair processJustificationAndFinalization 14.733 us/op 6.4160 us/op 2.30
mainnet_e81889 - altair processInactivityUpdates 6.6122 ms/op 3.9963 ms/op 1.65
mainnet_e81889 - altair processRewardsAndPenalties 66.853 ms/op 59.768 ms/op 1.12
mainnet_e81889 - altair processRegistryUpdates 2.4830 us/op 2.0420 us/op 1.22
mainnet_e81889 - altair processSlashings 462.00 ns/op 654.00 ns/op 0.71
mainnet_e81889 - altair processEth1DataReset 522.00 ns/op 543.00 ns/op 0.96
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.4344 ms/op 1.7551 ms/op 0.82
mainnet_e81889 - altair processSlashingsReset 3.7410 us/op 2.5220 us/op 1.48
mainnet_e81889 - altair processRandaoMixesReset 4.5530 us/op 3.2740 us/op 1.39
mainnet_e81889 - altair processHistoricalRootsUpdate 778.00 ns/op 847.00 ns/op 0.92
mainnet_e81889 - altair processParticipationFlagUpdates 1.6060 us/op 1.8350 us/op 0.88
mainnet_e81889 - altair processSyncCommitteeUpdates 644.00 ns/op 601.00 ns/op 1.07
mainnet_e81889 - altair afterProcessEpoch 119.12 ms/op 76.094 ms/op 1.57
capella processEpoch - mainnet_e217614 2.1107 s/op 1.8391 s/op 1.15
mainnet_e217614 - capella beforeProcessEpoch 529.12 ms/op 423.99 ms/op 1.25
mainnet_e217614 - capella processJustificationAndFinalization 17.484 us/op 8.6740 us/op 2.02
mainnet_e217614 - capella processInactivityUpdates 18.923 ms/op 13.127 ms/op 1.44
mainnet_e217614 - capella processRewardsAndPenalties 437.94 ms/op 356.26 ms/op 1.23
mainnet_e217614 - capella processRegistryUpdates 36.782 us/op 18.422 us/op 2.00
mainnet_e217614 - capella processSlashings 804.00 ns/op 536.00 ns/op 1.50
mainnet_e217614 - capella processEth1DataReset 497.00 ns/op 643.00 ns/op 0.77
mainnet_e217614 - capella processEffectiveBalanceUpdates 11.438 ms/op 4.6015 ms/op 2.49
mainnet_e217614 - capella processSlashingsReset 3.2960 us/op 2.9050 us/op 1.13
mainnet_e217614 - capella processRandaoMixesReset 4.6340 us/op 3.2250 us/op 1.44
mainnet_e217614 - capella processHistoricalRootsUpdate 588.00 ns/op 638.00 ns/op 0.92
mainnet_e217614 - capella processParticipationFlagUpdates 1.5730 us/op 1.7640 us/op 0.89
mainnet_e217614 - capella afterProcessEpoch 331.36 ms/op 194.91 ms/op 1.70
phase0 processEpoch - mainnet_e58758 423.82 ms/op 410.08 ms/op 1.03
mainnet_e58758 - phase0 beforeProcessEpoch 132.63 ms/op 102.86 ms/op 1.29
mainnet_e58758 - phase0 processJustificationAndFinalization 21.109 us/op 10.950 us/op 1.93
mainnet_e58758 - phase0 processRewardsAndPenalties 52.446 ms/op 50.957 ms/op 1.03
mainnet_e58758 - phase0 processRegistryUpdates 11.341 us/op 7.0530 us/op 1.61
mainnet_e58758 - phase0 processSlashings 445.00 ns/op 649.00 ns/op 0.69
mainnet_e58758 - phase0 processEth1DataReset 461.00 ns/op 487.00 ns/op 0.95
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.1525 ms/op 1.4023 ms/op 0.82
mainnet_e58758 - phase0 processSlashingsReset 3.0510 us/op 2.0230 us/op 1.51
mainnet_e58758 - phase0 processRandaoMixesReset 3.9740 us/op 2.8320 us/op 1.40
mainnet_e58758 - phase0 processHistoricalRootsUpdate 491.00 ns/op 514.00 ns/op 0.96
mainnet_e58758 - phase0 processParticipationRecordUpdates 4.5050 us/op 2.8550 us/op 1.58
mainnet_e58758 - phase0 afterProcessEpoch 94.354 ms/op 60.067 ms/op 1.57
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.3802 ms/op 1.6740 ms/op 0.82
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.4938 ms/op 1.0873 ms/op 1.37
altair processInactivityUpdates - 250000 normalcase 22.051 ms/op 22.680 ms/op 0.97
altair processInactivityUpdates - 250000 worstcase 26.792 ms/op 22.261 ms/op 1.20
phase0 processRegistryUpdates - 250000 normalcase 8.9880 us/op 3.4300 us/op 2.62
phase0 processRegistryUpdates - 250000 badcase_full_deposits 329.04 us/op 390.30 us/op 0.84
phase0 processRegistryUpdates - 250000 worstcase 0.5 126.38 ms/op 127.75 ms/op 0.99
altair processRewardsAndPenalties - 250000 normalcase 56.225 ms/op 59.381 ms/op 0.95
altair processRewardsAndPenalties - 250000 worstcase 54.574 ms/op 58.324 ms/op 0.94
phase0 getAttestationDeltas - 250000 normalcase 8.9249 ms/op 5.6716 ms/op 1.57
phase0 getAttestationDeltas - 250000 worstcase 8.7464 ms/op 5.6654 ms/op 1.54
phase0 processSlashings - 250000 worstcase 80.563 us/op 83.052 us/op 0.97
altair processSyncCommitteeUpdates - 250000 146.17 ms/op 120.30 ms/op 1.22
BeaconState.hashTreeRoot - No change 261.00 ns/op 323.00 ns/op 0.81
BeaconState.hashTreeRoot - 1 full validator 136.09 us/op 144.40 us/op 0.94
BeaconState.hashTreeRoot - 32 full validator 1.5506 ms/op 1.7379 ms/op 0.89
BeaconState.hashTreeRoot - 512 full validator 15.239 ms/op 14.698 ms/op 1.04
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 166.75 us/op 162.05 us/op 1.03
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.5325 ms/op 1.9621 ms/op 1.29
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 28.119 ms/op 29.319 ms/op 0.96
BeaconState.hashTreeRoot - 1 balances 132.59 us/op 126.88 us/op 1.05
BeaconState.hashTreeRoot - 32 balances 1.4135 ms/op 950.00 us/op 1.49
BeaconState.hashTreeRoot - 512 balances 12.044 ms/op 9.5242 ms/op 1.26
BeaconState.hashTreeRoot - 250000 balances 192.66 ms/op 154.08 ms/op 1.25
aggregationBits - 2048 els - zipIndexesInBitList 16.321 us/op 10.487 us/op 1.56
byteArrayEquals 32 71.882 ns/op 63.985 ns/op 1.12
Buffer.compare 32 53.542 ns/op 38.764 ns/op 1.38
byteArrayEquals 1024 1.9588 us/op 1.7406 us/op 1.13
Buffer.compare 1024 67.608 ns/op 46.018 ns/op 1.47
byteArrayEquals 16384 31.182 us/op 27.660 us/op 1.13
Buffer.compare 16384 229.92 ns/op 230.80 ns/op 1.00
byteArrayEquals 123687377 240.70 ms/op 207.94 ms/op 1.16
Buffer.compare 123687377 6.2558 ms/op 3.7136 ms/op 1.68
byteArrayEquals 32 - diff last byte 71.033 ns/op 61.464 ns/op 1.16
Buffer.compare 32 - diff last byte 55.372 ns/op 39.006 ns/op 1.42
byteArrayEquals 1024 - diff last byte 2.0087 us/op 1.7440 us/op 1.15
Buffer.compare 1024 - diff last byte 71.119 ns/op 47.193 ns/op 1.51
byteArrayEquals 16384 - diff last byte 32.027 us/op 27.807 us/op 1.15
Buffer.compare 16384 - diff last byte 267.54 ns/op 220.08 ns/op 1.22
byteArrayEquals 123687377 - diff last byte 237.35 ms/op 206.00 ms/op 1.15
Buffer.compare 123687377 - diff last byte 6.0944 ms/op 4.0857 ms/op 1.49
byteArrayEquals 32 - random bytes 5.3430 ns/op 4.5160 ns/op 1.18
Buffer.compare 32 - random bytes 59.366 ns/op 40.050 ns/op 1.48
byteArrayEquals 1024 - random bytes 5.0990 ns/op 4.3570 ns/op 1.17
Buffer.compare 1024 - random bytes 59.862 ns/op 37.933 ns/op 1.58
byteArrayEquals 16384 - random bytes 5.1400 ns/op 4.3690 ns/op 1.18
Buffer.compare 16384 - random bytes 58.770 ns/op 37.882 ns/op 1.55
byteArrayEquals 123687377 - random bytes 8.4900 ns/op 7.6400 ns/op 1.11
Buffer.compare 123687377 - random bytes 62.260 ns/op 41.260 ns/op 1.51
regular array get 100000 times 43.655 us/op 40.550 us/op 1.08
wrappedArray get 100000 times 43.459 us/op 40.457 us/op 1.07
arrayWithProxy get 100000 times 13.673 ms/op 10.322 ms/op 1.32
ssz.Root.equals 52.392 ns/op 54.596 ns/op 0.96
byteArrayEquals 50.324 ns/op 53.374 ns/op 0.94
Buffer.compare 10.314 ns/op 9.5080 ns/op 1.08
shuffle list - 16384 els 6.7713 ms/op 4.5352 ms/op 1.49
shuffle list - 250000 els 99.520 ms/op 67.637 ms/op 1.47
processSlot - 1 slots 16.274 us/op 14.281 us/op 1.14
processSlot - 32 slots 3.8114 ms/op 2.7485 ms/op 1.39
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 56.789 ms/op 51.186 ms/op 1.11
getCommitteeAssignments - req 1 vs - 250000 vc 2.4673 ms/op 2.2252 ms/op 1.11
getCommitteeAssignments - req 100 vs - 250000 vc 3.6483 ms/op 3.2855 ms/op 1.11
getCommitteeAssignments - req 1000 vs - 250000 vc 3.9813 ms/op 3.5894 ms/op 1.11
findModifiedValidators - 10000 modified validators 531.74 ms/op 419.57 ms/op 1.27
findModifiedValidators - 1000 modified validators 391.38 ms/op 323.61 ms/op 1.21
findModifiedValidators - 100 modified validators 402.73 ms/op 297.64 ms/op 1.35
findModifiedValidators - 10 modified validators 407.11 ms/op 297.55 ms/op 1.37
findModifiedValidators - 1 modified validators 389.41 ms/op 288.07 ms/op 1.35
findModifiedValidators - no difference 389.40 ms/op 323.10 ms/op 1.21
compare ViewDUs 4.3221 s/op 3.9315 s/op 1.10
compare each validator Uint8Array 1.8178 s/op 1.6450 s/op 1.11
compare ViewDU to Uint8Array 1.1058 s/op 746.93 ms/op 1.48
migrate state 1000000 validators, 24 modified, 0 new 771.07 ms/op 758.48 ms/op 1.02
migrate state 1000000 validators, 1700 modified, 1000 new 1.0592 s/op 966.06 ms/op 1.10
migrate state 1000000 validators, 3400 modified, 2000 new 1.3224 s/op 1.1745 s/op 1.13
migrate state 1500000 validators, 24 modified, 0 new 787.93 ms/op 738.90 ms/op 1.07
migrate state 1500000 validators, 1700 modified, 1000 new 1.0825 s/op 998.45 ms/op 1.08
migrate state 1500000 validators, 3400 modified, 2000 new 1.3054 s/op 1.1351 s/op 1.15
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.1300 ns/op 4.2300 ns/op 0.98
state getBlockRootAtSlot - 250000 vs - 7PWei 739.68 ns/op 862.94 ns/op 0.86
computeProposers - vc 250000 9.2115 ms/op 6.5636 ms/op 1.40
computeEpochShuffling - vc 250000 100.61 ms/op 65.894 ms/op 1.53
getNextSyncCommittee - vc 250000 152.62 ms/op 110.79 ms/op 1.38
computeSigningRoot for AttestationData 30.620 us/op 27.931 us/op 1.10
hash AttestationData serialized data then Buffer.toString(base64) 2.2437 us/op 1.1564 us/op 1.94
toHexString serialized data 1.0308 us/op 746.89 ns/op 1.38
Buffer.toString(base64) 216.68 ns/op 152.70 ns/op 1.42

by benchmarkbot/action

@wemeetagain wemeetagain merged commit 21851b2 into unstable Dec 25, 2023
20 of 23 checks passed
@wemeetagain wemeetagain deleted the nh/vitest-upgrade branch December 25, 2023 20:04
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.14.0 🎉

@nflaig nflaig mentioned this pull request Jan 16, 2024
Merged
ensi321 pushed a commit to ensi321/lodestar that referenced this pull request Jan 22, 2024
@nazarhussain @ensi321
deps: upgrade vitest (ChainSafe#6237)
0af8660 
* Upgrade vitest

* Change the browser version to fix the download error

* Add a browser version fix

* Fix the browser download path

* Fix the browser download version
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nflaig nflaig nflaig approved these changes

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees

@nazarhussain nazarhussain

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@nazarhussain @wemeetagain @nflaig