Skip to content

[SPARK-54693][CORE][TESTS] Add LZ4TPCDSDataBenchmark #53453

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
pan3793 wants to merge 9 commits into from
Closed

[SPARK-54693][CORE][TESTS] Add LZ4TPCDSDataBenchmark #53453

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
ba67e02
LZ4TPCDSDataBenchmark
pan3793 Dec 12, 2025
7b66018
GHA workflow
pan3793 Dec 12, 2025
9433bd7
refactor
pan3793 Dec 12, 2025
bf961b0
fix import
pan3793 Dec 14, 2025
061ea81
Benchmark results for org.apache.spark.io.LZ4TPCDSDataBenchmark (JDK …
pan3793 Dec 14, 2025
b5c73de
Benchmark results for org.apache.spark.io.LZ4TPCDSDataBenchmark (JDK …
pan3793 Dec 14, 2025
d752379
Benchmark results for org.apache.spark.io.ZStandardTPCDSDataBenchmark…
pan3793 Dec 14, 2025
ea7b879
Benchmark results for org.apache.spark.io.ZStandardTPCDSDataBenchmark…
pan3793 Dec 14, 2025
f02e559
address comment
pan3793 Dec 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/benchmark.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ jobs:
# Any TPC-DS related updates on this job need to be applied to tpcds-1g job of build_and_test.yml as well
tpcds-1g-gen:
name: "Generate an TPC-DS dataset with SF=1"
if: contains(inputs.class, 'TPCDSQueryBenchmark') || contains(inputs.class, 'ZStandardTPCDSDataBenchmark') || contains(inputs.class, '*')
if: contains(inputs.class, 'TPCDSQueryBenchmark') || contains(inputs.class, 'LZ4TPCDSDataBenchmark') || contains(inputs.class, 'ZStandardTPCDSDataBenchmark') || contains(inputs.class, '*')
runs-on: ubuntu-latest
env:
SPARK_LOCAL_IP: localhost
Expand Down Expand Up @@ -177,7 +177,7 @@ jobs:
distribution: zulu
java-version: ${{ inputs.jdk }}
- name: Cache TPC-DS generated data
if: contains(inputs.class, 'TPCDSQueryBenchmark') || contains(inputs.class, 'ZStandardTPCDSDataBenchmark') || contains(inputs.class, '*')
if: contains(inputs.class, 'TPCDSQueryBenchmark') || contains(inputs.class, 'LZ4TPCDSDataBenchmark') || contains(inputs.class, 'ZStandardTPCDSDataBenchmark') || contains(inputs.class, '*')
id: cache-tpcds-sf-1
uses: actions/cache@v4
with:
Expand Down
17 changes: 17 additions & 0 deletions core/benchmarks/LZ4TPCDSDataBenchmark-jdk21-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
================================================================================================
Benchmark LZ4CompressionCodec
================================================================================================

OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Compression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Compression 4 times 2621 2633 16 0.0 655315176.3 1.0X

OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Decompression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Decompression 4 times 2270 2286 23 0.0 567457203.5 1.0X


17 changes: 17 additions & 0 deletions core/benchmarks/LZ4TPCDSDataBenchmark-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
================================================================================================
Benchmark LZ4CompressionCodec
================================================================================================

OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Compression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Compression 4 times 2614 2621 10 0.0 653597000.8 1.0X

OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Decompression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Decompression 4 times 2346 2361 22 0.0 586455894.5 1.0X


60 changes: 30 additions & 30 deletions core/benchmarks/ZStandardTPCDSDataBenchmark-jdk21-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,48 +2,48 @@
Benchmark ZStandardCompressionCodec
================================================================================================

OpenJDK 64-Bit Server VM 21.0.8+9-LTS on Linux 6.11.0-1018-azure
OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
Compression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------
Compression 4 times at level 1 without buffer pool 2567 2573 9 0.0 641834272.8 1.0X
Compression 4 times at level 2 without buffer pool 4171 4173 2 0.0 1042717610.7 0.6X
Compression 4 times at level 3 without buffer pool 6202 6205 4 0.0 1550416592.3 0.4X
Compression 4 times at level 1 with buffer pool 2562 2562 0 0.0 640541340.8 1.0X
Compression 4 times at level 2 with buffer pool 4172 4173 1 0.0 1043037897.5 0.6X
Compression 4 times at level 3 with buffer pool 6199 6203 4 0.0 1549874630.3 0.4X
Compression 4 times at level 1 without buffer pool 2585 2586 1 0.0 646239352.5 1.0X
Compression 4 times at level 2 without buffer pool 4211 4216 7 0.0 1052689958.8 0.6X
Compression 4 times at level 3 without buffer pool 6328 6328 1 0.0 1581904435.8 0.4X
Compression 4 times at level 1 with buffer pool 2585 2587 3 0.0 646306514.0 1.0X
Compression 4 times at level 2 with buffer pool 4193 4195 3 0.0 1048293261.0 0.6X
Compression 4 times at level 3 with buffer pool 6264 6284 28 0.0 1565962696.5 0.4X

OpenJDK 64-Bit Server VM 21.0.8+9-LTS on Linux 6.11.0-1018-azure
OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
Decompression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Decompression 4 times from level 1 without buffer pool 856 875 17 0.0 214044635.0 1.0X
Decompression 4 times from level 2 without buffer pool 1141 1147 10 0.0 285134371.0 0.8X
Decompression 4 times from level 3 without buffer pool 1345 1345 0 0.0 336239892.8 0.6X
Decompression 4 times from level 1 with buffer pool 844 851 12 0.0 210917530.8 1.0X
Decompression 4 times from level 2 with buffer pool 1111 1126 22 0.0 277630951.0 0.8X
Decompression 4 times from level 3 with buffer pool 1338 1348 13 0.0 334616619.0 0.6X
Decompression 4 times from level 1 without buffer pool 845 877 53 0.0 211244491.3 1.0X
Decompression 4 times from level 2 without buffer pool 1141 1145 6 0.0 285267829.3 0.7X
Decompression 4 times from level 3 without buffer pool 1358 1366 11 0.0 339611143.3 0.6X
Decompression 4 times from level 1 with buffer pool 856 862 10 0.0 213948489.5 1.0X
Decompression 4 times from level 2 with buffer pool 1153 1156 5 0.0 288195943.3 0.7X
Decompression 4 times from level 3 with buffer pool 1368 1375 9 0.0 342032342.0 0.6X

OpenJDK 64-Bit Server VM 21.0.8+9-LTS on Linux 6.11.0-1018-azure
OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parallel Compression with 0 workers 2099 2099 0 0.0 524768920.0 1.0X
Parallel Compression with 1 workers 2119 2119 0 0.0 529758581.0 1.0X
Parallel Compression with 2 workers 1087 1090 4 0.0 271687124.0 1.9X
Parallel Compression with 4 workers 761 764 2 0.0 190289606.5 2.8X
Parallel Compression with 8 workers 782 789 7 0.0 195588720.8 2.7X
Parallel Compression with 16 workers 897 908 10 0.0 224272497.0 2.3X
Parallel Compression with 0 workers 2128 2130 3 0.0 531987145.5 1.0X
Parallel Compression with 1 workers 2117 2131 20 0.0 529324483.0 1.0X
Parallel Compression with 2 workers 1106 1107 0 0.0 276552237.3 1.9X
Parallel Compression with 4 workers 771 774 3 0.0 192777338.5 2.8X
Parallel Compression with 8 workers 815 826 13 0.0 203648175.7 2.6X
Parallel Compression with 16 workers 950 963 11 0.0 237496152.5 2.2X

OpenJDK 64-Bit Server VM 21.0.8+9-LTS on Linux 6.11.0-1018-azure
OpenJDK 64-Bit Server VM 21.0.9+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parallel Compression with 0 workers 8240 8242 2 0.0 2060062709.3 1.0X
Parallel Compression with 1 workers 6915 6924 13 0.0 1728757390.0 1.2X
Parallel Compression with 2 workers 3663 3664 1 0.0 915832528.8 2.2X
Parallel Compression with 4 workers 3239 3247 12 0.0 809829698.3 2.5X
Parallel Compression with 8 workers 3594 3610 23 0.0 898542204.8 2.3X
Parallel Compression with 16 workers 3888 3898 14 0.0 972017914.3 2.1X
Parallel Compression with 0 workers 8976 9140 231 0.0 2244064460.3 1.0X
Parallel Compression with 1 workers 7198 7214 24 0.0 1799376873.8 1.2X
Parallel Compression with 2 workers 3836 3850 20 0.0 959020774.8 2.3X
Parallel Compression with 4 workers 3271 3284 18 0.0 817803690.0 2.7X
Parallel Compression with 8 workers 3806 3807 2 0.0 951490679.3 2.4X
Parallel Compression with 16 workers 4004 4026 31 0.0 1000957120.3 2.2X


68 changes: 34 additions & 34 deletions core/benchmarks/ZStandardTPCDSDataBenchmark-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,48 +2,48 @@
Benchmark ZStandardCompressionCodec
================================================================================================

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Compression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------
Compression 4 times at level 1 without buffer pool 2513 2519 10 0.0 628127696.5 1.0X
Compression 4 times at level 2 without buffer pool 3914 3916 3 0.0 978555442.0 0.6X
Compression 4 times at level 3 without buffer pool 5417 5424 9 0.0 1354342306.3 0.5X
Compression 4 times at level 1 with buffer pool 2524 2526 4 0.0 630890054.5 1.0X
Compression 4 times at level 2 with buffer pool 3911 3911 0 0.0 977705511.5 0.6X
Compression 4 times at level 3 with buffer pool 5447 5451 5 0.0 1361830044.0 0.5X
Compression 4 times at level 1 without buffer pool 2572 2573 0 0.0 643092504.0 1.0X
Compression 4 times at level 2 without buffer pool 4223 4224 2 0.0 1055729472.5 0.6X
Compression 4 times at level 3 without buffer pool 6306 6307 1 0.0 1576606903.0 0.4X
Compression 4 times at level 1 with buffer pool 2566 2567 2 0.0 641403366.5 1.0X
Compression 4 times at level 2 with buffer pool 4229 4229 0 0.0 1057252850.2 0.6X
Compression 4 times at level 3 with buffer pool 6369 6370 1 0.0 1592238794.8 0.4X

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Decompression: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Decompression 4 times from level 1 without buffer pool 1053 1056 4 0.0 263342668.0 1.0X
Decompression 4 times from level 2 without buffer pool 1401 1403 3 0.0 350193821.5 0.8X
Decompression 4 times from level 3 without buffer pool 1683 1683 1 0.0 420625735.0 0.6X
Decompression 4 times from level 1 with buffer pool 1078 1079 2 0.0 269507650.5 1.0X
Decompression 4 times from level 2 with buffer pool 1397 1403 8 0.0 349213546.5 0.8X
Decompression 4 times from level 3 with buffer pool 1679 1680 2 0.0 419721856.3 0.6X
Decompression 4 times from level 1 without buffer pool 914 915 1 0.0 228498988.8 1.0X
Decompression 4 times from level 2 without buffer pool 1186 1188 2 0.0 296544159.0 0.8X
Decompression 4 times from level 3 without buffer pool 1424 1424 0 0.0 355996464.8 0.6X
Decompression 4 times from level 1 with buffer pool 915 916 2 0.0 228733774.3 1.0X
Decompression 4 times from level 2 with buffer pool 1189 1192 4 0.0 297227461.0 0.8X
Decompression 4 times from level 3 with buffer pool 1421 1425 5 0.0 355242896.0 0.6X

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Parallel Compression at level 3: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parallel Compression with 0 workers 1815 1825 14 0.0 453734902.0 1.0X
Parallel Compression with 1 workers 1654 1663 12 0.0 413617141.5 1.1X
Parallel Compression with 2 workers 857 859 2 0.0 214195314.3 2.1X
Parallel Compression with 4 workers 777 781 3 0.0 194366718.5 2.3X
Parallel Compression with 8 workers 784 786 3 0.0 195965343.5 2.3X
Parallel Compression with 16 workers 836 858 19 0.0 208885356.8 2.2X
Parallel Compression with 0 workers 2142 2143 2 0.0 535512459.0 1.0X
Parallel Compression with 1 workers 2145 2146 2 0.0 536274942.0 1.0X
Parallel Compression with 2 workers 1094 1100 9 0.0 273416030.8 2.0X
Parallel Compression with 4 workers 768 769 2 0.0 192023783.8 2.8X
Parallel Compression with 8 workers 831 839 13 0.0 207743301.0 2.6X
Parallel Compression with 16 workers 960 972 16 0.0 240059822.0 2.2X

OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
OpenJDK 64-Bit Server VM 17.0.17+10-LTS on Linux 6.11.0-1018-azure
AMD EPYC 7763 64-Core Processor
Parallel Compression at level 9: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parallel Compression with 0 workers 8302 8310 12 0.0 2075384302.0 1.0X
Parallel Compression with 1 workers 6869 6871 3 0.0 1717196107.5 1.2X
Parallel Compression with 2 workers 3570 3587 25 0.0 892437927.8 2.3X
Parallel Compression with 4 workers 3152 3152 1 0.0 787940909.5 2.6X
Parallel Compression with 8 workers 3463 3470 10 0.0 865739615.8 2.4X
Parallel Compression with 16 workers 4061 4083 31 0.0 1015251097.3 2.0X
Parallel Compression with 0 workers 9016 9031 21 0.0 2254017491.8 1.0X
Parallel Compression with 1 workers 7423 7467 62 0.0 1855653850.8 1.2X
Parallel Compression with 2 workers 4203 4242 54 0.0 1050838310.7 2.1X
Parallel Compression with 4 workers 3472 3481 13 0.0 867935936.0 2.6X
Parallel Compression with 8 workers 3952 3996 62 0.0 988086500.5 2.3X
Parallel Compression with 16 workers 4081 4115 47 0.0 1020289087.7 2.2X


Loading