Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-6887][VL] Daily Update Velox Version (2024_08_22) #6967

Merged
merged 1 commit into from
Aug 22, 2024

Conversation

GlutenPerfBot
Copy link
Contributor

Upstream Velox's New Commits:

8b75147a8 by Kevin Wilfong, Cache the hash map in SubscriptUtil if a single map is reused with complex keys (10414)
f369a2653 by Chengcheng Jin, Fix spill time metric unit (10783)
74a318307 by hitarth, Handle array of map and array of array case accurately in parquet reader (9728)
df771053f by Karthikeyan Natarajan, Add separate map for Custom Bridges (10626)
55107b6f7 by duanmeng, Add Query Trace Writers and Readers (10774)
46ba09580 by Jialiang Tan, Add shrink target adjustment mechanism in memory arbitration (10769)
94c6a51b5 by Krishna Pai, Fix Spark build. (10790)
08dd2d486 by Urvish Desai, Add near zero-copy Import & Export for Arrow BinaryView/Utf8View formats (9726)

Copy link

#6887

@zhouyuan
Copy link
Contributor

note: also run into this issue
#6965

@zhouyuan
Copy link
Contributor

@GlutenPerfBot benchmark

@GlutenPerfBot
Copy link
Contributor Author

ACK, will benchmark TPCH/DS on this pull request

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6967_time.csv log/native_master_08_21_2024_fbd066a8e6_time.csv difference percentage
q1 39.53 40.11 0.582 101.47%
q2 30.41 29.85 -0.559 98.16%
q3 51.72 53.61 1.891 103.66%
q4 41.99 41.68 -0.317 99.24%
q5 104.92 107.77 2.850 102.72%
q6 13.62 13.03 -0.593 95.65%
q7 116.36 116.21 -0.153 99.87%
q8 115.12 116.50 1.382 101.20%
q9 170.87 169.24 -1.625 99.05%
q10 64.99 65.91 0.916 101.41%
q11 27.87 27.11 -0.759 97.28%
q12 29.56 30.53 0.969 103.28%
q13 51.20 52.12 0.924 101.80%
q14 26.44 27.39 0.947 103.58%
q15 55.74 54.11 -1.626 97.08%
q16 20.66 19.44 -1.225 94.07%
q17 132.21 129.61 -2.594 98.04%
q18 197.87 198.26 0.392 100.20%
q19 27.90 26.31 -1.596 94.28%
q20 42.79 42.09 -0.700 98.36%
q21 392.22 386.50 -5.715 98.54%
q22 17.50 17.58 0.084 100.48%
total 1771.48 1764.95 -6.526 99.63%

@GlutenPerfBot
Copy link
Contributor Author

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6967_time.csv log/native_master_08_21_2024_fbd066a8e6_time.csv difference percentage
q1 13.90 14.05 0.152 101.10%
q2 14.08 14.33 0.254 101.80%
q3 2.63 4.31 1.678 163.77%
q4 72.08 72.54 0.458 100.64%
q5 9.54 9.57 0.034 100.35%
q6 4.30 2.49 -1.807 57.98%
q7 4.99 6.91 1.920 138.46%
q8 5.49 3.45 -2.040 62.86%
q9 25.67 23.67 -1.992 92.24%
q10 9.98 10.06 0.074 100.74%
q11 38.48 38.49 0.015 100.04%
q12 1.49 1.36 -0.126 91.57%
q13 6.48 6.57 0.086 101.32%
q14a 46.53 45.87 -0.665 98.57%
q14b 43.01 42.04 -0.969 97.75%
q15 2.75 2.30 -0.455 83.49%
q16 45.64 46.53 0.892 101.96%
q17 5.10 4.98 -0.113 97.78%
q18 7.01 6.82 -0.186 97.35%
q19 2.02 3.54 1.519 175.03%
q20 1.48 1.60 0.111 107.50%
q21 1.30 1.04 -0.253 80.53%
q22 7.61 7.68 0.076 101.00%
q23a 108.62 105.71 -2.907 97.32%
q23b 129.14 128.97 -0.169 99.87%
q24a 110.30 113.15 2.856 102.59%
q24b 107.94 111.98 4.039 103.74%
q25 3.99 4.11 0.118 102.95%
q26 3.09 3.14 0.044 101.42%
q27 3.76 6.99 3.233 185.94%
q28 29.31 30.50 1.191 104.06%
q29 10.90 9.37 -1.530 85.97%
q30 4.99 5.14 0.151 103.02%
q31 7.41 7.57 0.152 102.05%
q32 1.30 1.47 0.164 112.56%
q33 4.30 4.39 0.091 102.11%
q34 3.87 4.12 0.253 106.54%
q35 7.97 7.73 -0.247 96.90%
q36 4.84 4.64 -0.194 96.00%
q37 5.52 4.63 -0.892 83.83%
q38 14.95 13.69 -1.268 91.52%
q39a 3.47 3.09 -0.381 89.03%
q39b 3.12 2.98 -0.134 95.69%
q40 4.12 3.73 -0.387 90.60%
q41 0.60 0.72 0.118 119.83%
q42 0.86 0.96 0.098 111.32%
q43 4.62 4.60 -0.024 99.47%
q44 10.08 9.34 -0.736 92.70%
q45 3.32 3.26 -0.066 98.00%
q46 3.74 3.79 0.052 101.39%
q47 18.86 18.67 -0.192 98.98%
q48 5.56 5.23 -0.331 94.04%
q49 8.88 9.24 0.357 104.02%
q50 21.48 21.69 0.203 100.95%
q51 9.95 10.12 0.164 101.65%
q52 1.04 1.12 0.076 107.26%
q53 2.39 2.39 0.001 100.02%
q54 3.92 3.84 -0.077 98.03%
q55 1.01 1.20 0.188 118.57%
q56 4.32 4.16 -0.170 96.08%
q57 11.23 10.92 -0.309 97.25%
q58 2.44 3.12 0.680 127.86%
q59 10.92 11.01 0.098 100.90%
q60 4.01 4.05 0.038 100.96%
q61 4.17 3.99 -0.183 95.61%
q62 4.69 4.54 -0.156 96.67%
q63 2.42 2.32 -0.105 95.65%
q64 59.89 59.69 -0.202 99.66%
q65 17.57 17.20 -0.370 97.90%
q66 3.90 3.93 0.021 100.53%
q67 399.67 390.83 -8.833 97.79%
q68 3.72 3.74 0.020 100.53%
q69 5.95 5.42 -0.530 91.09%
q70 12.41 13.04 0.631 105.09%
q71 2.43 2.38 -0.054 97.78%
q72 211.95 214.73 2.780 101.31%
q73 2.33 2.20 -0.131 94.38%
q74 23.00 23.22 0.223 100.97%
q75 26.89 27.08 0.186 100.69%
q76 11.83 12.48 0.655 105.54%
q77 2.43 2.26 -0.162 93.34%
q78 49.84 50.04 0.198 100.40%
q79 3.81 3.95 0.134 103.51%
q80 12.48 12.38 -0.107 99.14%
q81 4.86 4.84 -0.018 99.64%
q82 7.42 7.13 -0.289 96.10%
q83 1.60 1.71 0.104 106.50%
q84 2.77 2.75 -0.020 99.26%
q85 7.04 7.16 0.122 101.73%
q86 4.09 3.98 -0.101 97.52%
q87 13.53 13.39 -0.133 99.02%
q88 21.79 21.39 -0.399 98.17%
q89 3.54 3.56 0.025 100.72%
q90 3.18 3.33 0.151 104.75%
q91 2.22 2.01 -0.204 90.82%
q92 1.34 1.34 0.003 100.23%
q93 39.78 41.13 1.351 103.40%
q94 24.82 25.33 0.517 102.08%
q9 89.99 88.76 -1.226 98.64%
q5 2.62 2.74 0.113 104.32%
q96 17.57 17.46 -0.116 99.34%
q97 1.85 2.02 0.172 109.32%
q98 10.57 10.21 -0.363 96.56%
q99 10.57 10.21 -0.363 96.56%
total 2195.70 2192.41 -3.285 99.85%

@zhouyuan zhouyuan merged commit af567e8 into apache:main Aug 22, 2024
41 checks passed
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
Upstream Velox's New Commits:

8b75147a8 by Kevin Wilfong, Cache the hash map in SubscriptUtil if a single map is reused with complex keys (10414)
f369a2653 by Chengcheng Jin, Fix spill time metric unit (10783)
74a318307 by hitarth, Handle array of map and array of array case accurately in parquet reader (9728)
df771053f by Karthikeyan Natarajan, Add separate map for Custom Bridges (10626)
55107b6f7 by duanmeng, Add Query Trace Writers and Readers (10774)
46ba09580 by Jialiang Tan, Add shrink target adjustment mechanism in memory arbitration (10769)
94c6a51b5 by Krishna Pai, Fix Spark build. (10790)
08dd2d486 by Urvish Desai, Add near zero-copy Import & Export for Arrow BinaryView/Utf8View formats (9726)

Signed-off-by: glutenperfbot <[email protected]>
Co-authored-by: glutenperfbot <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants