Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Daily Update Velox Version 2024-02-08 #4674

Merged
merged 4 commits into from
Feb 8, 2024

Conversation

GlutenPerfBot
Copy link
Contributor

@GlutenPerfBot GlutenPerfBot commented Feb 8, 2024

What changes were proposed in this pull request?

2abff36c5 (HEAD, upstream/main) Register Hive Connector in JoinFuzzer (#8705)
6d56baf82 Add ntile() spark window function (#8597)
8f5f15379 Remove FieldReference::addNullFast usage (#8699)
0539862e7 Add stats for null skew in join operator (#8700)
51b239cad Always run RIGHT SEMI JOIN single-threaded (#8701)
a9e7cd590 Fix 'Too many open files' error in JoinFuzzer (#8702)
02a4f6c3d Add new APIs to AddressableNonNullValueList to copy/append a stream of bytes (#8653)
693452a02 Rename VectorSerializer to IterativeVectorSerializer to distinguish it from BatchVectorSerializer (#8605)
127dc3b06 Limit array size in reduce Presto function (#8698)

How was this patch tested?

pass GHA

Signed-off-by: glutenperfbot <glutenperfbot@intel-internal.com>
Copy link

github-actions bot commented Feb 8, 2024

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@zhouyuan
Copy link
Contributor

zhouyuan commented Feb 8, 2024

related with facebookincubator/velox#8605

zhouyuan
zhouyuan previously approved these changes Feb 8, 2024
Copy link

github-actions bot commented Feb 8, 2024

Run Gluten Clickhouse CI

@zhouyuan zhouyuan merged commit 65f9402 into apache:main Feb 8, 2024
17 of 19 checks passed
@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_4674_time.csv log/native_master_02_07_2024_97bd0f617_time.csv difference percentage
q1 33.31 35.50 2.191 106.58%
q2 24.35 24.29 -0.053 99.78%
q3 37.74 38.36 0.620 101.64%
q4 36.13 36.87 0.741 102.05%
q5 71.18 71.83 0.657 100.92%
q6 5.47 5.46 -0.013 99.77%
q7 84.98 85.75 0.766 100.90%
q8 85.65 84.87 -0.773 99.10%
q9 122.16 127.82 5.657 104.63%
q10 44.36 45.72 1.355 103.05%
q11 20.94 20.96 0.019 100.09%
q12 26.37 27.17 0.795 103.01%
q13 45.62 45.11 -0.509 98.88%
q14 17.30 15.13 -2.170 87.46%
q15 27.59 27.64 0.053 100.19%
q16 14.51 14.10 -0.411 97.16%
q17 104.14 101.18 -2.965 97.15%
q18 146.89 147.35 0.458 100.31%
q19 13.90 12.54 -1.366 90.17%
q20 27.83 26.13 -1.699 93.90%
q21 223.66 223.64 -0.011 99.99%
q22 13.86 13.71 -0.150 98.92%
total 1227.94 1231.13 3.190 100.26%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_08_2024_time.csv log/native_master_02_07_2024_97bd0f617_time.csv difference percentage
q1 35.43 35.50 0.072 100.20%
q2 24.58 24.29 -0.281 98.86%
q3 37.88 38.36 0.486 101.28%
q4 35.66 36.87 1.211 103.40%
q5 70.39 71.83 1.443 102.05%
q6 6.64 5.46 -1.176 82.28%
q7 83.70 85.75 2.050 102.45%
q8 83.27 84.87 1.597 101.92%
q9 123.18 127.82 4.637 103.76%
q10 42.39 45.72 3.328 107.85%
q11 20.24 20.96 0.716 103.54%
q12 29.47 27.17 -2.303 92.19%
q13 45.31 45.11 -0.199 99.56%
q14 15.44 15.13 -0.314 97.97%
q15 28.57 27.64 -0.928 96.75%
q16 14.23 14.10 -0.134 99.06%
q17 100.37 101.18 0.806 100.80%
q18 149.02 147.35 -1.669 98.88%
q19 15.13 12.54 -2.596 82.85%
q20 26.37 26.13 -0.234 99.11%
q21 224.74 223.64 -1.095 99.51%
q22 13.86 13.71 -0.142 98.98%
total 1225.86 1231.13 5.274 100.43%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_09_2024_time.csv log/native_master_02_08_2024_65f940287_time.csv difference percentage
q1 32.21 35.43 3.219 110.00%
q2 25.40 24.58 -0.822 96.76%
q3 37.67 37.88 0.203 100.54%
q4 38.80 35.66 -3.143 91.90%
q5 71.45 70.39 -1.061 98.51%
q6 7.11 6.64 -0.473 93.35%
q7 83.82 83.70 -0.121 99.86%
q8 85.94 83.27 -2.665 96.90%
q9 123.62 123.18 -0.434 99.65%
q10 42.75 42.39 -0.364 99.15%
q11 20.43 20.24 -0.191 99.07%
q12 27.13 29.47 2.345 108.65%
q13 46.86 45.31 -1.544 96.70%
q14 18.37 15.44 -2.930 84.05%
q15 29.12 28.57 -0.555 98.10%
q16 14.33 14.23 -0.098 99.32%
q17 101.31 100.37 -0.936 99.08%
q18 152.65 149.02 -3.633 97.62%
q19 13.79 15.13 1.345 109.75%
q20 27.76 26.37 -1.391 94.99%
q21 225.86 224.74 -1.122 99.50%
q22 13.78 13.86 0.076 100.55%
total 1240.15 1225.86 -14.295 98.85%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_10_2024_time.csv log/native_master_02_09_2024_65f940287_time.csv difference percentage
q1 35.07 32.21 -2.864 91.83%
q2 24.27 25.40 1.130 104.66%
q3 38.79 37.67 -1.115 97.13%
q4 38.37 38.80 0.428 101.12%
q5 70.87 71.45 0.580 100.82%
q6 6.97 7.11 0.142 102.04%
q7 84.04 83.82 -0.226 99.73%
q8 85.07 85.94 0.871 101.02%
q9 126.16 123.62 -2.544 97.98%
q10 44.95 42.75 -2.200 95.11%
q11 20.66 20.43 -0.231 98.88%
q12 29.06 27.13 -1.939 93.33%
q13 47.32 46.86 -0.468 99.01%
q14 19.01 18.37 -0.639 96.64%
q15 29.06 29.12 0.058 100.20%
q16 12.76 14.33 1.565 112.26%
q17 103.67 101.31 -2.363 97.72%
q18 148.94 152.65 3.714 102.49%
q19 12.63 13.79 1.156 109.15%
q20 28.27 27.76 -0.509 98.20%
q21 226.74 225.86 -0.883 99.61%
q22 13.77 13.78 0.008 100.06%
total 1246.48 1240.15 -6.329 99.49%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_11_2024_time.csv log/native_master_02_10_2024_65f940287_time.csv difference percentage
q1 32.57 35.07 2.504 107.69%
q2 24.18 24.27 0.088 100.37%
q3 38.60 38.79 0.195 100.50%
q4 37.37 38.37 0.998 102.67%
q5 70.52 70.87 0.351 100.50%
q6 6.76 6.97 0.206 103.05%
q7 84.84 84.04 -0.795 99.06%
q8 86.79 85.07 -1.724 98.01%
q9 126.04 126.16 0.119 100.09%
q10 43.67 44.95 1.281 102.93%
q11 20.86 20.66 -0.196 99.06%
q12 28.46 29.06 0.605 102.13%
q13 44.75 47.32 2.573 105.75%
q14 19.02 19.01 -0.012 99.94%
q15 28.58 29.06 0.486 101.70%
q16 13.84 12.76 -1.072 92.25%
q17 102.69 103.67 0.975 100.95%
q18 148.46 148.94 0.478 100.32%
q19 12.59 12.63 0.046 100.37%
q20 26.92 28.27 1.351 105.02%
q21 226.86 226.74 -0.121 99.95%
q22 13.85 13.77 -0.078 99.43%
total 1238.22 1246.48 8.258 100.67%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_12_2024_time.csv log/native_master_02_11_2024_65f940287_time.csv difference percentage
q1 34.33 32.57 -1.766 94.86%
q2 24.28 24.18 -0.099 99.59%
q3 38.39 38.60 0.206 100.54%
q4 37.95 37.37 -0.574 98.49%
q5 70.33 70.52 0.194 100.28%
q6 7.09 6.76 -0.331 95.33%
q7 85.24 84.84 -0.405 99.52%
q8 85.96 86.79 0.836 100.97%
q9 123.47 126.04 2.574 102.09%
q10 42.49 43.67 1.182 102.78%
q11 20.53 20.86 0.329 101.60%
q12 28.57 28.46 -0.114 99.60%
q13 45.01 44.75 -0.257 99.43%
q14 15.14 19.02 3.886 125.67%
q15 27.31 28.58 1.270 104.65%
q16 14.37 13.84 -0.531 96.30%
q17 102.63 102.69 0.068 100.07%
q18 148.90 148.46 -0.435 99.71%
q19 12.50 12.59 0.084 100.68%
q20 26.50 26.92 0.416 101.57%
q21 227.26 226.86 -0.394 99.83%
q22 14.05 13.85 -0.196 98.60%
total 1232.28 1238.22 5.944 100.48%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants