Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Benchmark Remark with Event #8222

Closed
wants to merge 11 commits into from

Conversation

shawntabrizi
Copy link
Member

@shawntabrizi shawntabrizi commented Feb 27, 2021

This PR will be used to run benchmarks against Remarks with Events

#8120

@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet frame_system

@parity-benchapp
Copy link

parity-benchapp bot commented Feb 27, 2021

Finished benchmark for branch: shawntabrizi-benchmark-remark-event

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/system/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "frame_system", Extrinsic: "remark", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 1.301
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 1.163 0.011 0.9%
78643 1.303 0.009 0.6%
157286 1.305 0.008 0.6%
235929 1.303 0.005 0.3%
314572 1.323 0.008 0.6%
393215 1.318 0.014 1.0%
471858 1.321 0.014 1.0%
550501 1.352 0.015 1.1%
629144 1.317 0.008 0.6%
707787 1.333 0.017 1.2%
786430 1.334 0.01 0.7%
865073 1.318 0.006 0.4%
943716 1.325 0.016 1.2%
1022359 1.3 0.009 0.6%
1101002 1.316 0.02 1.5%
1179645 1.303 0.013 0.9%
1258288 1.308 0.013 0.9%
1336931 1.309 0.013 0.9%
1415574 1.302 0.012 0.9%
1494217 1.311 0.005 0.3%
1572860 1.311 0.011 0.8%
1651503 1.313 0.012 0.9%
1730146 1.322 0.005 0.3%
1808789 1.318 0.011 0.8%
1887432 1.322 0.016 1.2%
1966075 1.337 0.011 0.8%
2044718 1.331 0.008 0.6%
2123361 1.346 0.03 2.2%
2202004 1.327 0.01 0.7%
2280647 1.333 0.009 0.6%
2359290 1.351 0.013 0.9%
2437933 1.323 0.012 0.9%
2516576 1.347 0.019 1.4%
2595219 1.337 0.008 0.5%
2673862 1.339 0.016 1.1%
2752505 1.354 0.008 0.5%
2831148 1.333 0.006 0.4%
2909791 1.317 0.007 0.5%
2988434 1.334 0.016 1.1%
3067077 1.343 0.008 0.5%
3145720 1.361 0.014 1.0%
3224363 1.347 0.012 0.8%
3303006 1.36 0.016 1.1%
3381649 1.339 0.016 1.1%
3460292 1.33 0.008 0.6%
3538935 1.361 0.02 1.4%
3617578 1.346 0.01 0.7%
3696221 1.353 0.01 0.7%
3774864 1.363 0.022 1.6%
3853507 1.379 0.017 1.2%
3932150 1.355 0.01 0.7%

Quality and confidence:
param error
b 0

Model:
Time ~= 1.296
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "remark_with_event", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 15.89
+ b 0
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
b mean µs sigma µs %
0 16.8 0.092 0.5%
78643 95.1 0.084 0.0%
157286 172.3 0.096 0.0%
235929 248.8 0.186 0.0%
314572 325.2 0.548 0.1%
393215 403.6 0.143 0.0%
471858 480.9 0.052 0.0%
550501 557.8 0.704 0.1%
629144 633.2 0.1 0.0%
707787 715.8 0.173 0.0%
786430 792.5 0.136 0.0%
865073 866.4 1.398 0.1%
943716 946 1.137 0.1%
1022359 1023 0.689 0.0%
1101002 1097 1.627 0.1%
1179645 1178 0.977 0.0%
1258288 1259 9.449 0.7%
1336931 1334 6.934 0.5%
1415574 1408 8.979 0.6%
1494217 1576 47.19 2.9%
1572860 1595 1.273 0.0%
1651503 1672 1.51 0.0%
1730146 1759 1.469 0.0%
1808789 1839 1.844 0.1%
1887432 1918 1.21 0.0%
1966075 1996 1.42 0.0%
2044718 2074 2.211 0.1%
2123361 2117 11.79 0.5%
2202004 2196 13.07 0.5%
2280647 2272 10.27 0.4%
2359290 2349 11.64 0.4%
2437933 2427 10.37 0.4%
2516576 2520 10.99 0.4%
2595219 2587 10.81 0.4%
2673862 2675 10.79 0.4%
2752505 2741 9.277 0.3%
2831148 2817 11.1 0.3%
2909791 2911 12.51 0.4%
2988434 2998 6.935 0.2%
3067077 3081 13.28 0.4%
3145720 3147 10.5 0.3%
3224363 3220 13.31 0.4%
3303006 3306 11.06 0.3%
3381649 3378 11.4 0.3%
3460292 3467 5.637 0.1%
3538935 3538 11.79 0.3%
3617578 3615 13.91 0.3%
3696221 3705 10.09 0.2%
3774864 3777 12.4 0.3%
3853507 3860 13.08 0.3%
3932150 3941 13.55 0.3%

Quality and confidence:
param error
b 0

Model:
Time ~= 13.47
+ b 0.001
µs

Reads = 0 + (0 * b)
Writes = 0 + (0 * b)
Pallet: "frame_system", Extrinsic: "set_heap_pages", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 2.024
µs

Reads = 0
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 2.024
µs

Reads = 0
Writes = 1
Pallet: "frame_system", Extrinsic: "set_changes_trie_config", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 10.55
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 10.55
µs

Reads = 1
Writes = 2
Pallet: "frame_system", Extrinsic: "set_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0
+ i 0.61
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 2.069 0.019 0.9%
20 12.8 0.12 0.9%
39 23.67 0.1 0.4%
58 35.05 0.049 0.1%
77 45.75 0.133 0.2%
96 56.75 0.139 0.2%
115 68.52 0.112 0.1%
134 80.35 0.102 0.1%
153 91.59 0.258 0.2%
172 102.2 0.129 0.1%
191 115.3 0.13 0.1%
210 126.1 0.112 0.0%
229 138.3 0.178 0.1%
248 150.1 0.149 0.0%
267 161.7 0.825 0.5%
286 172.1 0.238 0.1%
305 181.9 0.294 0.1%
324 195.8 0.181 0.0%
343 207.2 0.475 0.2%
362 218.1 0.241 0.1%
381 232.2 2.188 0.9%
400 244.9 0.242 0.0%
419 251.4 0.435 0.1%
438 265.4 0.611 0.2%
457 277.2 0.301 0.1%
476 288.3 0.944 0.3%
495 299.3 0.488 0.1%
514 310.5 0.435 0.1%
533 324.4 0.521 0.1%
552 333.3 0.274 0.0%
571 344.7 0.434 0.1%
590 358.9 2.966 0.8%
609 367.9 0.608 0.1%
628 379.7 0.377 0.0%
647 392.2 0.653 0.1%
666 402.6 0.593 0.1%
685 415.7 0.451 0.1%
704 428.2 0.498 0.1%
723 439.2 0.394 0.0%
742 451.4 0.596 0.1%
761 460.8 0.278 0.0%
780 476.6 0.376 0.0%
799 483.7 0.188 0.0%
818 496.9 0.675 0.1%
837 509.4 0.628 0.1%
856 522.5 0.585 0.1%
875 534.8 0.957 0.1%
894 547.9 4.099 0.7%
913 558.2 0.851 0.1%
932 567.7 1.225 0.2%
951 582.3 0.422 0.0%
970 597.3 8.871 1.4%
989 606.6 0.804 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0
+ i 0.612
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_storage", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 0.663
+ i 0.442
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
i mean µs sigma µs %
1 1.943 0.026 1.3%
20 9.88 0.053 0.5%
39 17.97 0.074 0.4%
58 25.49 0.078 0.3%
77 34.01 0.1 0.2%
96 41.76 0.148 0.3%
115 51.29 0.082 0.1%
134 60.73 0.52 0.8%
153 68.53 0.247 0.3%
172 76.35 0.105 0.1%
191 86.07 0.153 0.1%
210 93.83 0.133 0.1%
229 102.9 0.342 0.3%
248 112.5 0.178 0.1%
267 120.6 0.274 0.2%
286 130 0.509 0.3%
305 136.5 0.219 0.1%
324 147.8 0.206 0.1%
343 156.4 0.278 0.1%
362 163.9 0.218 0.1%
381 172.6 0.238 0.1%
400 181.4 0.395 0.2%
419 190.4 0.393 0.2%
438 201.3 0.309 0.1%
457 196.4 0.3 0.1%
476 204.7 0.319 0.1%
495 212.9 0.336 0.1%
514 221.2 0.371 0.1%
533 231.7 0.258 0.1%
552 239.1 0.388 0.1%
571 246.5 0.337 0.1%
590 256 0.23 0.0%
609 264.6 0.585 0.2%
628 273 0.477 0.1%
647 281 0.273 0.0%
666 289.1 0.398 0.1%
685 298.5 0.328 0.1%
704 308.9 0.643 0.2%
723 324.2 9.916 3.0%
742 332.4 9.346 2.8%
761 332.1 0.55 0.1%
780 344.2 0.545 0.1%
799 349.6 0.449 0.1%
818 361.5 3.406 0.9%
837 378.4 8.596 2.2%
856 382.3 3.996 1.0%
875 407.7 8.515 2.0%
894 395.1 0.283 0.0%
913 403.4 0.317 0.0%
932 410.5 0.478 0.1%
951 423 0.729 0.1%
970 429.2 0.334 0.0%
989 440.4 0.699 0.1%

Quality and confidence:
param error
i 0

Model:
Time ~= 0.562
+ i 0.442
µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)
Pallet: "frame_system", Extrinsic: "kill_prefix", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 4.91
+ p 0.855
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
1 4.741 0.06 1.2%
20 21.43 0.075 0.3%
39 37.42 0.167 0.4%
58 55.27 0.194 0.3%
77 67.59 0.202 0.2%
96 83.77 0.152 0.1%
115 98.67 0.266 0.2%
134 115.6 0.185 0.1%
153 133 0.236 0.1%
172 151 0.245 0.1%
191 165.8 0.326 0.1%
210 182.3 0.231 0.1%
229 201.8 0.309 0.1%
248 213.5 0.379 0.1%
267 231.1 0.551 0.2%
286 247.5 0.42 0.1%
305 261.9 0.442 0.1%
324 284.8 0.525 0.1%
343 297.3 0.285 0.0%
362 318.7 0.645 0.2%
381 335.9 0.642 0.1%
400 347.7 0.656 0.1%
419 366.6 0.433 0.1%
438 387.4 0.554 0.1%
457 399.6 0.395 0.0%
476 424 0.92 0.2%
495 436.1 0.897 0.2%
514 449.9 0.698 0.1%
533 471.6 0.539 0.1%
552 485.2 1.035 0.2%
571 502.2 1.107 0.2%
590 520.8 0.611 0.1%
609 528.7 0.594 0.1%
628 555 0.864 0.1%
647 579.7 4.38 0.7%
666 583.8 1.004 0.1%
685 604.9 1.186 0.1%
704 626.1 1.408 0.2%
723 624.3 1.263 0.2%
742 635.4 12.94 2.0%
761 642.6 0.673 0.1%
780 654.4 0.896 0.1%
799 670.2 2.52 0.3%
818 689.9 8.254 1.1%
837 701.7 1.282 0.1%
856 736.3 11.58 1.5%
875 730.9 1.417 0.1%
894 746 1.814 0.2%
913 763.9 1.29 0.1%
932 780.6 2.243 0.2%
951 800.6 1.4 0.1%
970 820.9 11.03 1.3%
989 818.6 1.262 0.1%

Quality and confidence:
param error
p 0.001

Model:
Time ~= 10.49
+ p 0.84
µs

Reads = 0 + (0 * p)
Writes = 0 + (1 * p)

@github-actions github-actions bot added the A0-please_review Pull request needs code review. label Feb 27, 2021
Parity Benchmarking Bot added 2 commits February 27, 2021 19:48
…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/system/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi shawntabrizi deleted the shawntabrizi-benchmark-remark-event branch February 27, 2021 21:35
@shawntabrizi shawntabrizi restored the shawntabrizi-benchmark-remark-event branch February 27, 2021 21:40
@shawntabrizi shawntabrizi deleted the shawntabrizi-benchmark-remark-event branch February 27, 2021 21:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A0-please_review Pull request needs code review.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants