Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Daily Update Velox Version (2024_05_30) #5919

Merged
merged 2 commits into from
May 30, 2024

Conversation

GlutenPerfBot
Copy link
Contributor

Upstream Velox's New Commits:

3f9d0c8b6 by Wei He, Fix integer overflow failure in spark SumAggregationTest (9964)
493714867 by Jia Ke, Enable kLeftSemiFilter and kRightSemiFilter join type in SMJ (9877)
5b52dca23 by Bikramjeet Vig, Fix NaN handling for map subscript and add test for map() (9881)
b7bd2a44d by Weihan Tang, Add expm1 Spark function (9667)
38d6563dd by rui-mo, Support date-type partition filter (9937)
f38a6cf5f by rui-mo, Add conversion and url to spark_functions.rst (9876)
0ca30a74f by Jimmy Lu, Fix row number column when it is the only column projected (9944)
c04d3ed80 by NEUpanning, Fix typos in How to add a scalar function? documentation (9965)
e9bbc381c by Ubuntu, Wave nulls and selective reader (9946)
f32714356 by Masha Basmanova, Do not pre-allocate error vector in TRY (9971)
178e1728b by Jimmy Lu, Optimize selective flat map reader for Nimble and DWRF (9889)
ec1ee29e6 by zhouyifan279, Permission denied when build velox on a new machine (9789)
80fe90669 by Jialiang Tan, Parallelize connector reclaim (9885)
4d4160c85 by rui-mo, Fix the path to copy hive.properties from scripts (9967)
971795d41 by Krishna Pai, Quote cast(x as json) when x is nan(), or infinity(). (9882)
c13651c57 by xiaoxmeng, Remove shrink pool from memory reclaim execution path (9935)

Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@zhouyuan
Copy link
Contributor

/Benchmark Velox TPCDS

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_5919_time.csv log/native_master_05_29_2024_588faae351_time.csv difference percentage
q1 16.29 16.97 0.686 104.21%
q2 14.95 14.94 -0.010 99.93%
q3 4.88 4.96 0.081 101.66%
q4 63.61 64.00 0.392 100.62%
q5 8.01 7.81 -0.208 97.41%
q6 2.27 2.42 0.146 106.42%
q7 5.52 5.64 0.119 102.15%
q8 5.10 5.59 0.485 109.50%
q9 18.71 18.71 -0.006 99.97%
q10 9.91 9.65 -0.257 97.40%
q11 35.14 35.04 -0.102 99.71%
q12 1.32 1.39 0.069 105.24%
q13 5.55 6.52 0.973 117.55%
q14a 42.07 44.10 2.033 104.83%
q14b 43.72 43.05 -0.670 98.47%
q15 2.43 2.47 0.043 101.77%
q16 39.80 39.09 -0.708 98.22%
q17 4.74 5.64 0.892 118.80%
q18 6.07 6.47 0.400 106.59%
q19 3.40 1.91 -1.490 56.19%
q20 3.54 1.21 -2.328 34.22%
q21 1.11 2.41 1.296 216.82%
q22 8.48 8.78 0.297 103.50%
q23a 84.02 81.60 -2.418 97.12%
q23b 102.13 102.04 -0.092 99.91%
q24a 70.25 76.07 5.824 108.29%
q24b 70.39 68.64 -1.748 97.52%
q25 6.01 4.14 -1.865 68.94%
q26 2.79 3.07 0.281 110.09%
q27 8.83 3.01 -5.820 34.11%
q28 19.88 22.76 2.874 114.46%
q29 9.14 6.60 -2.537 72.23%
q30 4.01 4.28 0.268 106.67%
q31 6.17 5.97 -0.199 96.77%
q32 1.02 0.96 -0.060 94.11%
q33 4.84 4.84 -0.008 99.84%
q34 4.61 6.25 1.639 135.57%
q35 6.24 6.40 0.155 102.48%
q36 4.57 2.98 -1.594 65.13%
q37 3.88 3.86 -0.013 99.66%
q38 11.92 12.00 0.084 100.71%
q39a 3.22 3.22 -0.001 99.97%
q39b 2.76 2.75 -0.005 99.83%
q40 3.86 4.75 0.888 123.02%
q41 3.22 0.58 -2.640 18.12%
q42 0.98 0.86 -0.112 88.53%
q43 3.82 3.47 -0.349 90.86%
q44 7.35 6.87 -0.477 93.51%
q45 3.42 3.47 0.056 101.63%
q46 2.93 5.11 2.180 174.32%
q47 14.57 15.72 1.157 107.94%
q48 4.61 4.50 -0.106 97.70%
q49 7.25 7.64 0.383 105.27%
q50 24.78 22.54 -2.233 90.99%
q51 8.39 8.32 -0.072 99.15%
q52 0.95 1.01 0.060 106.29%
q53 1.82 1.74 -0.086 95.29%
q54 3.10 3.06 -0.049 98.41%
q55 0.98 0.98 -0.002 99.75%
q56 4.46 4.27 -0.193 95.68%
q57 8.37 8.43 0.066 100.79%
q58 2.53 2.52 -0.016 99.38%
q59 14.26 13.85 -0.411 97.12%
q60 4.64 4.58 -0.060 98.70%
q61 5.30 6.91 1.602 130.20%
q62 5.13 5.46 0.324 106.32%
q63 2.54 1.91 -0.625 75.37%
q64 48.55 48.49 -0.058 99.88%
q65 14.04 15.70 1.659 111.82%
q66 3.12 3.11 -0.007 99.79%
q67 352.21 353.82 1.609 100.46%
q68 3.57 3.62 0.046 101.29%
q69 6.03 9.38 3.349 155.53%
q70 8.63 8.84 0.207 102.40%
q71 4.19 2.28 -1.910 54.47%
q72 190.40 187.72 -2.681 98.59%
q73 4.94 2.29 -2.651 46.30%
q74 21.36 21.11 -0.242 98.87%
q75 23.90 23.43 -0.473 98.02%
q76 7.51 7.32 -0.191 97.45%
q77 1.73 1.85 0.111 106.42%
q78 40.47 40.94 0.470 101.16%
q79 3.47 3.38 -0.098 97.17%
q80 10.71 10.89 0.183 101.71%
q81 4.37 4.55 0.186 104.26%
q82 6.12 6.34 0.223 103.65%
q83 1.49 1.49 -0.003 99.83%
q84 4.80 4.82 0.028 100.59%
q85 6.81 6.85 0.034 100.50%
q86 3.25 3.24 -0.008 99.76%
q87 12.25 12.48 0.230 101.88%
q88 16.59 16.41 -0.175 98.95%
q89 2.64 2.61 -0.031 98.82%
q90 3.21 3.25 0.041 101.28%
q91 2.51 2.57 0.061 102.43%
q92 1.18 2.46 1.281 208.98%
q93 32.67 30.56 -2.119 93.52%
q94 21.60 21.42 -0.186 99.14%
q9 82.95 81.92 -1.026 98.76%
q5 5.89 5.38 -0.511 91.32%
q96 12.10 12.10 0.002 100.02%
q97 1.94 1.83 -0.110 94.30%
q98 9.50 9.29 -0.208 97.81%
q99 9.50 9.29 -0.208 97.81%
total 1889.23 1882.45 -6.783 99.64%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_5919_time.csv log/native_master_05_29_2024_588faae35_time.csv difference percentage
q1 34.61 33.56 -1.046 96.98%
q2 23.40 23.85 0.452 101.93%
q3 39.51 37.37 -2.134 94.60%
q4 32.02 32.42 0.398 101.24%
q5 68.09 69.83 1.743 102.56%
q6 10.05 7.54 -2.504 75.08%
q7 80.66 81.75 1.095 101.36%
q8 83.39 86.57 3.176 103.81%
q9 121.03 118.35 -2.681 97.78%
q10 43.66 44.16 0.493 101.13%
q11 19.83 22.23 2.400 112.10%
q12 27.14 26.72 -0.417 98.46%
q13 53.24 53.60 0.361 100.68%
q14 22.93 17.59 -5.335 76.73%
q15 28.98 32.89 3.916 113.51%
q16 14.10 13.41 -0.698 95.05%
q17 105.60 103.62 -1.972 98.13%
q18 146.25 144.53 -1.716 98.83%
q19 14.89 13.59 -1.307 91.23%
q20 31.11 29.66 -1.450 95.34%
q21 268.69 260.43 -8.260 96.93%
q22 12.16 13.84 1.682 113.83%
total 1281.30 1267.50 -13.803 98.92%

@PHILO-HE PHILO-HE merged commit 6cb8f7c into apache:main May 30, 2024
38 checks passed
@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_5919_time.csv log/native_master_05_29_2024_588faae35_time.csv difference percentage
q1 37.04 33.56 -3.480 90.61%
q2 23.54 23.85 0.315 101.34%
q3 38.29 37.37 -0.918 97.60%
q4 32.19 32.42 0.232 100.72%
q5 70.03 69.83 -0.202 99.71%
q6 7.52 7.54 0.028 100.37%
q7 81.36 81.75 0.388 100.48%
q8 84.15 86.57 2.414 102.87%
q9 120.73 118.35 -2.379 98.03%
q10 46.42 44.16 -2.267 95.12%
q11 20.53 22.23 1.695 108.26%
q12 30.37 26.72 -3.654 87.97%
q13 51.30 53.60 2.306 104.50%
q14 22.30 17.59 -4.714 78.87%
q15 29.44 32.89 3.452 111.72%
q16 13.92 13.41 -0.517 96.28%
q17 103.64 103.62 -0.013 99.99%
q18 144.40 144.53 0.132 100.09%
q19 16.35 13.59 -2.763 83.10%
q20 27.19 29.66 2.463 109.06%
q21 256.85 260.43 3.573 101.39%
q22 11.97 13.84 1.874 115.66%
total 1269.54 1267.50 -2.034 99.84%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants