Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: run end bool compressor #1355

Merged
merged 11 commits into from
Nov 19, 2024
Merged

feat: run end bool compressor #1355

merged 11 commits into from
Nov 19, 2024

Conversation

lwwmanning
Copy link
Member

@lwwmanning lwwmanning commented Nov 18, 2024

No description provided.

@lwwmanning lwwmanning marked this pull request as ready for review November 19, 2024 16:49
@lwwmanning lwwmanning added the benchmark Run benchmarks on this branch label Nov 19, 2024
@github-actions github-actions bot removed the benchmark Run benchmarks on this branch label Nov 19, 2024
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DataFusion

Benchmark suite Current: 299d4e3 Previous: 34803c1 Ratio
arrow/planning 805932.7532215603 ns (1266.2848178188433) 813466.0788183342 ns (2264.2571513023577) 0.99
arrow/exec 1749440.6367308483 ns (4742.97435657226) 1758226.8972807857 ns (4774.25705247547) 1.00
vortex-pushdown-compressed/planning 503902.97534311377 ns (1236.7882813626493) 506275.4990703953 ns (1814.1211810949026) 1.00
vortex-pushdown-compressed/exec 2572155.017499999 ns (11394.632443750044) 2579314.6920000003 ns (5415.886424999684) 1.00
vortex-pushdown-uncompressed/planning 499474.49116762757 ns (1323.734511197661) 506249.7944785131 ns (1298.675414915604) 0.99
vortex-pushdown-uncompressed/exec 1495783.0917070138 ns (4573.036773059866) 1497492.9381247663 ns (6167.478898719768) 1.00
vortex-nopushdown-compressed/planning 838622.0949969147 ns (1869.855678001768) 841427.4162845924 ns (1619.9645656427601) 1.00
vortex-nopushdown-compressed/exec 3344023.0726666683 ns (21762.187725000782) 3323110.241875 ns (14937.034171874868) 1.01
vortex-nopushdown-uncompressed/planning 827646.1202260118 ns (1902.8737679384067) 830241.9364258243 ns (1736.7158861067728) 1.00
vortex-nopushdown-uncompressed/exec 4947863.3563636355 ns (10429.45206817938) 4918028.316363636 ns (10108.73534090817) 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Vortex bytes_at

Benchmark suite Current: 299d4e3 Previous: 34803c1 Ratio
bytes_at/array_data 1120.7796757756325 ns (1.1716346315206465) 1133.1585234378167 ns (2.2377797974025952) 0.99
bytes_at/array_view 915.9187258422221 ns (1.672876258943461) 922.7528819719872 ns (0.9321556945836278) 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Random Access

Benchmark suite Current: 299d4e3 Previous: 34803c1 Ratio
random-access/vortex-tokio-local-disk 2709438.556842105 ns (21447.113697367953) 3518390.9893333334 ns (30826.27168333321) 0.77
random-access/vortex-local-fs 3423044.383333334 ns (16446.520708333235) 4207116.373846153 ns (20908.392634614836) 0.81
random-access/parquet-tokio-local-disk 218812116 ns (4476415.428749993) 215155049.33333334 ns (3246665.2979166806) 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TPC-H

Benchmark suite Current: 299d4e3 Previous: 34803c1 Ratio
tpch_q1/vortex-in-memory-pushdown 480028408.8 ns (4045609.1649999917) 449030960.85 ns (1081441.9481250048) 1.07
tpch_q1/arrow 608428258.2 ns (6510202.86500001) 536843491.1 ns (1663722.5075000226) 1.13
tpch_q1/parquet 782805794.3 ns (5668017.428749979) 744585572.9 ns (2411324.9799999595) 1.05
tpch_q1/vortex-file-compressed 570871583.2 ns (3003901.942499995) 563428907.3 ns (1834863.261250019) 1.01
tpch_q2/vortex-in-memory-pushdown 139929378.6414286 ns (1324006.7232380956) 134648492.97039682 ns (595392.3785466179) 1.04
tpch_q2/arrow 139844851.66916668 ns (2034987.0449687392) 133974719.53940472 ns (530957.0526785776) 1.04
tpch_q2/parquet 176653973.98904762 ns (626352.1564017832) 161249721.31849203 ns (796190.1771428734) 1.10
tpch_q2/vortex-file-compressed 178030352.3702381 ns (1051325.0028868914) 165406998.0347619 ns (1228315.7122976035) 1.08
tpch_q3/vortex-in-memory-pushdown 235169823.3 ns (1285539.3066666424) 214747343.36666667 ns (1135023.2154166698) 1.10
tpch_q3/arrow 178941503.79999998 ns (993438.223333329) 165897743.57869047 ns (592309.0903497189) 1.08
tpch_q3/parquet 398528349.05 ns (1543433.9168750048) 365109190.7 ns (1532267.1712500155) 1.09
tpch_q3/vortex-file-compressed 337432579.75 ns (1265993.9918749928) 305329445.3 ns (820079.4649999738) 1.11
tpch_q4/vortex-in-memory-pushdown 168311020.98007935 ns (816137.0785704553) 152535913.62646824 ns (440796.8376388699) 1.10
tpch_q4/arrow 191666700.79999998 ns (1555896.5541666746) 180202594.05099207 ns (325849.63748016953) 1.06
tpch_q4/parquet 224668931.8666667 ns (1325964.8333333135) 212874457.86666667 ns (615646.5733333379) 1.06
tpch_q4/vortex-file-compressed 216095048.43333334 ns (1821241.870416671) 196786071.26666668 ns (351877.5166666657) 1.10
tpch_q5/vortex-in-memory-pushdown 370247720.4 ns (2173811.5868749917) 331503199.55 ns (1455463.862500012) 1.12
tpch_q5/arrow 339916718.1 ns (1433736.4287499785) 308055308.25 ns (1560063.1099999845) 1.10
tpch_q5/parquet 525928239.6 ns (3278153.949999988) 482182462.4 ns (2326767.96875) 1.09
tpch_q5/vortex-file-compressed 384720942.2 ns (3584404.25) 343878345.1 ns (2974834.242500007) 1.12
tpch_q6/vortex-in-memory-pushdown 56017665.79087301 ns (172679.69910962507) 54227947.3868254 ns (104382.76668849215) 1.03
tpch_q6/arrow 28592744.342757933 ns (294754.78857936524) 26479665.507678572 ns (259722.77061681636) 1.08
tpch_q6/parquet 156458510.7970635 ns (569607.0366616994) 150101400.99444443 ns (511147.24972221255) 1.04
tpch_q6/vortex-file-compressed 12076457.841835316 ns (235196.3214534996) 10779198.56761023 ns (415532.7357186936) 1.12
tpch_q7/vortex-in-memory-pushdown 709260103.9 ns (5348740.133749962) 648580614.3 ns (2968481.8600000143) 1.09
tpch_q7/arrow 638516548.7 ns (4384303.563750029) 584829894.2 ns (1447885.5225000381) 1.09
tpch_q7/parquet 823558358.5 ns (8774050.900000036) 742584156.3 ns (1549548.550000012) 1.11
tpch_q7/vortex-file-compressed 730759063.3 ns (5248807.032500029) 677555002.2 ns (3293778.6850000024) 1.08
tpch_q8/vortex-in-memory-pushdown 305485117.85 ns (3012951.824999988) 285801578.45 ns (1503003.1643750072) 1.07
tpch_q8/arrow 279486579 ns (2440094.025000006) 261610119.7 ns (1128349.2618750036) 1.07
tpch_q8/parquet 574854694.6 ns (3933541.682500005) 529540359.3 ns (2452270.7274999917) 1.09
tpch_q8/vortex-file-compressed 325047011.4 ns (4731634.921249986) 293273965.5 ns (2006368.698750019) 1.11
tpch_q9/vortex-in-memory-pushdown 530614014.3 ns (4355902.549999982) 475414604.8 ns (3060167.074999988) 1.12
tpch_q9/arrow 494213189.8 ns (4437646.876249969) 456905568.25 ns (2796729.25) 1.08
tpch_q9/parquet 813413752.2 ns (4986984.398750007) 753491536.6 ns (4013314.550000012) 1.08
tpch_q9/vortex-file-compressed 563497149.3 ns (7058382.512499988) 495492647.2 ns (3482429.884374976) 1.14
tpch_q10/vortex-in-memory-pushdown 360837412.4 ns (2064249.7731249928) 336927522.3 ns (1582606.75) 1.07
tpch_q10/arrow 298566416.2 ns (1380885.3931249976) 275637910.6 ns (1424657.875) 1.08
tpch_q10/parquet 559812421.9 ns (2026103.761250019) 518416678.5 ns (1691275.481249988) 1.08
tpch_q10/vortex-file-compressed 371579241.55 ns (3626217.9431250095) 322448466.15 ns (1351305.449999988) 1.15
tpch_q11/vortex-in-memory-pushdown 160153762.31535715 ns (1023968.2724300623) 134356063.28563493 ns (1338705.0354404896) 1.19
tpch_q11/arrow 156442830.9144048 ns (2072219.4923854172) 129557539.4159524 ns (506888.5993839428) 1.21
tpch_q11/parquet 174482527.72230157 ns (1343983.1870208234) 136622517.89857143 ns (1084339.4766309708) 1.28
tpch_q11/vortex-file-compressed 210349102.89999998 ns (3142730.551666677) 191233652.33333334 ns (1388941.984583348) 1.10
tpch_q12/vortex-in-memory-pushdown 282748296.4 ns (1572466.9812500179) 264887869.65 ns (623904.1768749952) 1.07
tpch_q12/arrow 207708788.96666664 ns (2390098.4337499887) 196657318.63333333 ns (531414.6333333403) 1.06
tpch_q12/parquet 352998680.15 ns (1305930.1193749905) 332031885.95 ns (560703.275000006) 1.06
tpch_q12/vortex-file-compressed 222233326.4 ns (1425277.6666666716) 200224097.26666665 ns (721886.4679166675) 1.11
tpch_q13/vortex-in-memory-pushdown 202113952.7 ns (868014.7833333164) 170187283.1754762 ns (753719.8527351171) 1.19
tpch_q13/arrow 188352983.43333334 ns (2567294.312499985) 163530670.8930159 ns (636256.917230159) 1.15
tpch_q13/parquet 339375775.35 ns (6890690.642500013) 304160913.15 ns (2133621.482499987) 1.12
tpch_q13/vortex-file-compressed 209827794.63333333 ns (4056476.4666666687) 174671595.56944448 ns (760526.7570833415) 1.20
tpch_q14/vortex-in-memory-pushdown 106460412.75119048 ns (375033.61218450963) 91482637.06912698 ns (331564.1291646883) 1.16
tpch_q14/arrow 43784413.37544973 ns (248451.41025198624) 36086403.0494709 ns (252186.7676984109) 1.21
tpch_q14/parquet 249573796.8 ns (1144271.4800000042) 232497069.7666667 ns (504851.96541668475) 1.07
tpch_q14/vortex-file-compressed 90305784.27654761 ns (736824.3438690454) 79476146.82730159 ns (820523.189390868) 1.14
tpch_q15/vortex-in-memory-pushdown 117521327.75849207 ns (2531768.7681309506) 103778012.72416668 ns (674426.3017812595) 1.13
tpch_q15/arrow 79056513.85791667 ns (899505.9559375048) 69599539.0078373 ns (329204.7450396791) 1.14
tpch_q15/parquet 344118229.05 ns (2137911.169999987) 326436276.55 ns (819992.1550000012) 1.05
tpch_q15/vortex-file-compressed 171144870.25583333 ns (2143121.9525000006) 149949996.00281745 ns (526373.673529759) 1.14
tpch_q16/vortex-in-memory-pushdown 125358231.85301585 ns (773264.2365079448) 113114053.3052381 ns (722554.8517648801) 1.11
tpch_q16/arrow 108584826.3120635 ns (961082.163637884) 100471440.90837301 ns (437880.30265872926) 1.08
tpch_q16/parquet 123193119.83246031 ns (624406.6389285848) 109946176.72178574 ns (642929.0261904821) 1.12
tpch_q16/vortex-file-compressed 131416996.53051588 ns (648686.5258715302) 112690915.4895635 ns (669990.1969107315) 1.17
tpch_q17/vortex-in-memory-pushdown 828533416 ns (11153281.13625002) 717823093.1 ns (6454074.101249993) 1.15
tpch_q17/arrow 743270150 ns (2005933.4762499928) 631089222.6 ns (4644813.551249981) 1.18
tpch_q17/parquet 815223943.3 ns (14197273.466250002) 655761788.5 ns (3335088.157499969) 1.24
tpch_q17/vortex-file-compressed 685038147.6 ns (6120302.975000024) 637315045.2 ns (3303268.772500038) 1.07
tpch_q18/vortex-in-memory-pushdown 1296442265.2 ns (20221996.47750008) 1194643755.6 ns (6371992.8000000715) 1.09
tpch_q18/arrow 1297601810.6 ns (22829423.700000048) 1171560102.1 ns (5153957.588750005) 1.11
tpch_q18/parquet 1544563351 ns (19193388.5) 1379664586.7 ns (5371912.600000024) 1.12
tpch_q18/vortex-file-compressed 1325670133 ns (8713088.35500002) 1215501593.8 ns (6511642.299999952) 1.09
tpch_q19/vortex-in-memory-pushdown 283109678.75 ns (2735216.150000006) 269344375.65 ns (1038795.1162499934) 1.05
tpch_q19/arrow 176051618.67960316 ns (1062474.8809523582) 169432623.6778968 ns (510806.57895831764) 1.04
tpch_q19/parquet 449860886.7 ns (1408095.2262499928) 431531936.6 ns (1858084.4274999797) 1.04
tpch_q19/vortex-file-compressed 169274527.24091268 ns (2006928.5187852383) 153452195.74376982 ns (505312.5162371099) 1.10
tpch_q20/vortex-in-memory-pushdown 287050899.3 ns (4793478.474999994) 228784255.03333336 ns (1651206.9429166466) 1.25
tpch_q20/arrow 258507321.1 ns (1577952.2100000083) 209639278.7 ns (2125532.620416686) 1.23
tpch_q20/parquet 383581420.55 ns (5997349.383125037) 338634716 ns (1411911.0756250024) 1.13
tpch_q20/vortex-file-compressed 323204654.5 ns (3711278.917500019) 281031168.05 ns (2855429.3637500107) 1.15
tpch_q21/vortex-in-memory-pushdown 1184877942.1 ns (25726551.826249957) 1021022120.4 ns (5595607.07249999) 1.16
tpch_q21/arrow 1147189175.3 ns (18692093.52250004) 971136479.7 ns (4769744.088750005) 1.18
tpch_q21/parquet 1278936476.5 ns (12170523.950000048) 1072037891.6 ns (6149815.328750014) 1.19
tpch_q21/vortex-file-compressed 1286937209.1 ns (13706458.8950001) 1179220611.2 ns (5584535.648749948) 1.09
tpch_q22/vortex-in-memory-pushdown 88722535.60878967 ns (1019026.3172733113) 83614588.66250001 ns (543313.9942708388) 1.06
tpch_q22/arrow 89381968.22964285 ns (448699.15083333105) 81075894.63777778 ns (292864.89451389015) 1.10
tpch_q22/parquet 124377366.6909127 ns (1093305.5786681548) 109976211.96353173 ns (339096.1567777768) 1.13
tpch_q22/vortex-file-compressed 96103724.5470635 ns (712671.8182936385) 84860334.16107143 ns (234135.05486755818) 1.13

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Vortex Compression

Benchmark suite Current: 299d4e3 Previous: 34803c1 Ratio
compress time/taxi 1294022829.3 ns (2166541.758749962) 1322308741.2 ns (2558403.4499999285) 0.98
compress time/taxi throughput 470808924 bytes 470808924 bytes 1
parquet_rs-zstd compress time/taxi 1780856076.8 ns (2771644.5612499714) 1720874649.2 ns (3445018.366250038) 1.03
parquet_rs-zstd compress time/taxi throughput 470808924 bytes 470808924 bytes 1
decompress time/taxi 358439257.6 ns (6240758.25) 346793552 ns (1116679.5250000358) 1.03
decompress time/taxi throughput 470808924 bytes 470808924 bytes 1
parquet_rs-zstd decompress time/taxi 304937954.9 ns (955363.6437500119) 304505827.2 ns (737519) 1.00
parquet_rs-zstd decompress time/taxi throughput 470808924 bytes 470808924 bytes 1
vortex:parquet-zstd size/taxi 0.9846442179804045 ratio 0.988616140474021 ratio 1.00
vortex:raw size/taxi 0.11703604836513253 ratio 0.11750706747436249 ratio 1.00
vortex size/taxi 55101616 bytes 55323376 bytes 1.00
compress time/AirlineSentiment 934043.1628705052 ns (1212.4516253644833) 930524.4616423713 ns (1459.5395239311038) 1.00
compress time/AirlineSentiment throughput 2020 bytes 2020 bytes 1
parquet_rs-zstd compress time/AirlineSentiment 56162.7727207068 ns (295.6959647957083) 55827.51173782572 ns (653.7906515062605) 1.01
parquet_rs-zstd compress time/AirlineSentiment throughput 2020 bytes 2020 bytes 1
decompress time/AirlineSentiment 100131.96238794742 ns (785.7830375620179) 97643.44984706664 ns (590.678374852956) 1.03
decompress time/AirlineSentiment throughput 2020 bytes 2020 bytes 1
parquet_rs-zstd decompress time/AirlineSentiment 33165.09308177412 ns (60.59638070916117) 31866.546044740167 ns (178.32431351096602) 1.04
parquet_rs-zstd decompress time/AirlineSentiment throughput 2020 bytes 2020 bytes 1
vortex:parquet-zstd size/AirlineSentiment 9.427094105480869 ratio 9.427094105480869 ratio 1
vortex:raw size/AirlineSentiment 4.512871287128712 ratio 4.512871287128712 ratio 1
vortex size/AirlineSentiment 9116 bytes 9116 bytes 1
compress time/Arade 3084149507.6 ns (5765496.368750095) 3047825718.5 ns (6891614.299999952) 1.01
compress time/Arade throughput 787023760 bytes 787023760 bytes 1
parquet_rs-zstd compress time/Arade 2999088152.5 ns (8423566.89625001) 2915883554.2 ns (8260859.950000048) 1.03
parquet_rs-zstd compress time/Arade throughput 787023760 bytes 787023760 bytes 1
decompress time/Arade 635557927.3 ns (1022554.9499999881) 574748340.5 ns (928057.6037499905) 1.11
decompress time/Arade throughput 787023760 bytes 787023760 bytes 1
parquet_rs-zstd decompress time/Arade 668848618.3 ns (2861760.3124999404) 672229559.8 ns (4968140.873749971) 0.99
parquet_rs-zstd decompress time/Arade throughput 787023760 bytes 787023760 bytes 1
vortex:parquet-zstd size/Arade 0.48935487242401965 ratio 0.4893552915558884 ratio 1.00
vortex:raw size/Arade 0.1898870549981871 ratio 0.18988721763622485 ratio 1.00
vortex size/Arade 149445624 bytes 149445752 bytes 1.00
compress time/Bimbo 10747403941.1 ns (12924597.082500458) 10541080730.2 ns (9744307.849999428) 1.02
compress time/Bimbo throughput 7121333608 bytes 7121333608 bytes 1
parquet_rs-zstd compress time/Bimbo 20899631912.2 ns (39355554.45000076) 20026718004.3 ns (20801124.900001526) 1.04
parquet_rs-zstd compress time/Bimbo throughput 7121333608 bytes 7121333608 bytes 1
decompress time/Bimbo 3832990574.2 ns (4739661.150000095) 3878152052.9 ns (5551220.75) 0.99
decompress time/Bimbo throughput 7121333608 bytes 7121333608 bytes 1
parquet_rs-zstd decompress time/Bimbo 2669391572.7 ns (5878073.852499962) 2651418369 ns (4186538.3612499237) 1.01
parquet_rs-zstd decompress time/Bimbo throughput 7121333608 bytes 7121333608 bytes 1
vortex:parquet-zstd size/Bimbo 1.2813324155804635 ratio 1.2849324993313813 ratio 1.00
vortex:raw size/Bimbo 0.06983950582532518 ratio 0.07003572974586027 ratio 1.00
vortex size/Bimbo 497350420 bytes 498747796 bytes 1.00
compress time/CMSprovider 16413437619.8 ns (41881049.26249981) 16182144716.9 ns (35269224.85000038) 1.01
compress time/CMSprovider throughput 5149123964 bytes 5149123964 bytes 1
parquet_rs-zstd compress time/CMSprovider 19267570022.1 ns (59139849.40375137) 18894945351.1 ns (53348495.85000038) 1.02
parquet_rs-zstd compress time/CMSprovider throughput 5149123964 bytes 5149123964 bytes 1
decompress time/CMSprovider 3733372248.5 ns (480925895) 3841630898.5 ns (287505554.01374984) 0.97
decompress time/CMSprovider throughput 5149123964 bytes 5149123964 bytes 1
parquet_rs-zstd decompress time/CMSprovider 5681262536.7 ns (15781993.30000019) 5099261658.2 ns (12619732.368749619) 1.11
parquet_rs-zstd decompress time/CMSprovider throughput 5149123964 bytes 5149123964 bytes 1
vortex:parquet-zstd size/CMSprovider 1.236430549965703 ratio 1.2261404244350862 ratio 1.01
vortex:raw size/CMSprovider 0.1847810032642671 ratio 0.1832412368777067 ratio 1.01
vortex size/CMSprovider 951460292 bytes 943531844 bytes 1.01
compress time/Euro2016 2976630429.8 ns (5173986.399999857) 3008959527.3 ns (2878116.0999999046) 0.99
compress time/Euro2016 throughput 393253221 bytes 393253221 bytes 1
parquet_rs-zstd compress time/Euro2016 1561854613.5 ns (1744286.091250062) 1536283385.6 ns (1609409.207499981) 1.02
parquet_rs-zstd compress time/Euro2016 throughput 393253221 bytes 393253221 bytes 1
decompress time/Euro2016 313292732.8 ns (745058.1175000072) 307773609.7 ns (1114395.8837499917) 1.02
decompress time/Euro2016 throughput 393253221 bytes 393253221 bytes 1
parquet_rs-zstd decompress time/Euro2016 497763101 ns (2020798.9212499857) 484639507.9 ns (2191350.4924999774) 1.03
parquet_rs-zstd decompress time/Euro2016 throughput 393253221 bytes 393253221 bytes 1
vortex:parquet-zstd size/Euro2016 1.4434301371317566 ratio 1.444557364985118 ratio 1.00
vortex:raw size/Euro2016 0.4363835992585551 ratio 0.43672438731277424 ratio 1.00
vortex size/Euro2016 171609256 bytes 171743272 bytes 1.00
compress time/Food 1430808797.1 ns (7803941.451249957) 1398955056.4 ns (2950073.495000005) 1.02
compress time/Food throughput 332718229 bytes 332718229 bytes 1
parquet_rs-zstd compress time/Food 1072392237.1 ns (2708401.722500086) 1041617276 ns (1844620.2899999619) 1.03
parquet_rs-zstd compress time/Food throughput 332718229 bytes 332718229 bytes 1
decompress time/Food 162031719.3 ns (248278.35312499106) 158999240.85 ns (218168.01999998093) 1.02
decompress time/Food throughput 332718229 bytes 332718229 bytes 1
parquet_rs-zstd decompress time/Food 222572519.35 ns (311654.86625000834) 219972222.25 ns (485145.40000000596) 1.01
parquet_rs-zstd decompress time/Food throughput 332718229 bytes 332718229 bytes 1
vortex:parquet-zstd size/Food 1.277927777723955 ratio 1.2779242447415076 ratio 1.00
vortex:raw size/Food 0.13915480416914577 ratio 0.13915480416914577 ratio 1
vortex size/Food 46299340 bytes 46299340 bytes 1
compress time/HashTags 2964479354.8 ns (2392958.7112500668) 2901386715 ns (3934302.7062499523) 1.02
compress time/HashTags throughput 804495592 bytes 804495592 bytes 1
parquet_rs-zstd compress time/HashTags 2497500485.3 ns (2624545.4787499905) 2456102493.6 ns (4778337.5787501335) 1.02
parquet_rs-zstd compress time/HashTags throughput 804495592 bytes 804495592 bytes 1
decompress time/HashTags 493920288.3 ns (2289214) 471024538.7 ns (1462534.224999994) 1.05
decompress time/HashTags throughput 804495592 bytes 804495592 bytes 1
parquet_rs-zstd decompress time/HashTags 807009276.6 ns (4146046.8862499595) 783525096 ns (2112522.649999976) 1.03
parquet_rs-zstd decompress time/HashTags throughput 804495592 bytes 804495592 bytes 1
vortex:parquet-zstd size/HashTags 1.7198917291376024 ratio 1.6754776666451836 ratio 1.03
vortex:raw size/HashTags 0.28639827774221044 ratio 0.2790023988099117 ratio 1.03
vortex size/HashTags 230406152 bytes 224456200 bytes 1.03
compress time/TPC-H l_comment chunked without fsst 4631812731.2 ns (14737637.924999714) 4458843476.6 ns (13816340.420000076) 1.04
compress time/TPC-H l_comment chunked without fsst throughput 249197098 bytes 249197098 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst 909978060.1 ns (1691831.9012499452) 903505069.1 ns (1505090.449999988) 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst throughput 249197098 bytes 249197098 bytes 1
decompress time/TPC-H l_comment chunked without fsst 163221694.3 ns (519120.50499999523) 161222483 ns (810646.3662500083) 1.01
decompress time/TPC-H l_comment chunked without fsst throughput 249197098 bytes 249197098 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst 254337414 ns (813128.6649999917) 249887501.6 ns (751753.0425000042) 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst throughput 249197098 bytes 249197098 bytes 1
vortex:parquet-zstd size/TPC-H l_comment chunked without fsst 4.609868432642607 ratio 4.609487736179406 ratio 1.00
vortex:raw size/TPC-H l_comment chunked without fsst 1.0532231157844383 ratio 1.0532018956336322 ratio 1.00
vortex size/TPC-H l_comment chunked without fsst 262460144 bytes 262454856 bytes 1.00
compress time/TPC-H l_comment chunked 1345233869.5 ns (1536904.327500105) 1325905179.6 ns (1271735.5299999714) 1.01
compress time/TPC-H l_comment chunked throughput 249197098 bytes 249197098 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment chunked 910471871 ns (1878927.9662500024) 898355019.7 ns (1405521.9200000167) 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput 249197098 bytes 249197098 bytes 1
decompress time/TPC-H l_comment chunked 132045965.26666665 ns (1192944.1525000036) 128472744.4 ns (1408405.8562500179) 1.03
decompress time/TPC-H l_comment chunked throughput 249197098 bytes 249197098 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment chunked 253444114.6 ns (848039.6750000119) 249205054.45 ns (881037.375) 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput 249197098 bytes 249197098 bytes 1
vortex:parquet-zstd size/TPC-H l_comment chunked 1.3522881267709963 ratio 1.3522277209551181 ratio 1.00
vortex:raw size/TPC-H l_comment chunked 0.30895916773477033 ratio 0.3089646573653117 ratio 1.00
vortex size/TPC-H l_comment chunked 76991728 bytes 76993096 bytes 1.00
compress time/TPC-H l_comment canonical 1348307863.8 ns (1882470.058125019) 1328211172.2 ns (1337018.3899999857) 1.02
compress time/TPC-H l_comment canonical throughput 249197114 bytes 249197114 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment canonical 908121871.1 ns (1215239.449999988) 901007248.4 ns (1717745.2743750215) 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput 249197114 bytes 249197114 bytes 1
decompress time/TPC-H l_comment canonical 130248280.68970239 ns (562077.8568608612) 128456859.08650795 ns (882377.8777405918) 1.01
decompress time/TPC-H l_comment canonical throughput 249197114 bytes 249197114 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment canonical 252770430.81694445 ns (648001.8612395823) 248707909.89305553 ns (512546.658940956) 1.02
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput 249197114 bytes 249197114 bytes 1
vortex:parquet-zstd size/TPC-H l_comment canonical 1.3522908344683697 ratio 1.3522864551291407 ratio 1.00
vortex:raw size/TPC-H l_comment canonical 0.30895914789767587 ratio 0.3089646375278648 ratio 1.00
vortex size/TPC-H l_comment canonical 76991728 bytes 76993096 bytes 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Co-authored-by: Robert Kruszewski <github@robertk.io>
@lwwmanning lwwmanning enabled auto-merge (squash) November 19, 2024 18:05
@lwwmanning lwwmanning merged commit f7d0b79 into develop Nov 19, 2024
12 checks passed
@lwwmanning lwwmanning deleted the wm/reb branch November 19, 2024 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants