Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DNR] test simd cmp #6171

Closed
wants to merge 3 commits into from
Closed

[DNR] test simd cmp #6171

wants to merge 3 commits into from

Conversation

zhli1142015
Copy link
Contributor

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

(Fixes: #ISSUE-ID)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

@github-actions GitHub Actions
Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

@zhli1142015
Copy link
Contributor Author

/Benchmark TPCDS

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark TPCH

1 similar comment
@zhli1142015
Copy link
Contributor Author

/Benchmark TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_21_2024_ef7b2c516_time.csv difference percentage
q1 34.88 35.14 0.258 100.74%
q2 23.76 26.25 2.486 110.46%
q3 38.80 38.62 -0.180 99.54%
q4 32.73 34.48 1.751 105.35%
q5 70.85 70.26 -0.590 99.17%
q6 8.10 7.96 -0.144 98.22%
q7 82.11 85.08 2.975 103.62%
q8 87.40 83.21 -4.193 95.20%
q9 120.00 122.00 2.006 101.67%
q10 43.66 44.94 1.281 102.93%
q11 22.27 22.82 0.552 102.48%
q12 25.18 24.55 -0.631 97.49%
q13 38.23 38.63 0.400 101.05%
q14 18.01 18.18 0.171 100.95%
q15 31.46 30.13 -1.331 95.77%
q16 14.08 16.41 2.335 116.58%
q17 106.24 104.52 -1.714 98.39%
q18 147.66 148.17 0.511 100.35%
q19 13.87 13.73 -0.146 98.95%
q20 27.83 26.41 -1.415 94.92%
q21 262.59 262.85 0.258 100.10%
q22 12.35 12.55 0.204 101.65%
total 1262.06 1266.90 4.844 100.38%

@zhli1142015
Copy link
Contributor Author

/Benchmark TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cd_time.csv difference percentage
q1 35.69 36.88 1.189 103.33%
q2 23.69 23.65 -0.037 99.84%
q3 40.62 42.16 1.540 103.79%
q4 31.83 33.05 1.219 103.83%
q5 70.08 69.90 -0.177 99.75%
q6 6.27 7.95 1.680 126.81%
q7 81.93 80.73 -1.204 98.53%
q8 84.98 82.15 -2.828 96.67%
q9 123.74 119.99 -3.746 96.97%
q10 48.11 46.07 -2.038 95.76%
q11 20.06 20.48 0.423 102.11%
q12 29.25 26.53 -2.718 90.71%
q13 37.90 38.12 0.218 100.57%
q14 22.30 18.74 -3.561 84.03%
q15 29.96 32.95 2.982 109.95%
q16 13.93 14.22 0.294 102.11%
q17 104.18 104.72 0.536 100.51%
q18 147.92 148.08 0.161 100.11%
q19 16.93 14.64 -2.289 86.48%
q20 26.23 30.40 4.172 115.91%
q21 260.58 261.83 1.250 100.48%
q22 12.06 12.33 0.277 102.30%
total 1268.24 1265.58 -2.659 99.79%

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cde_time.csv difference percentage
q1 14.04 14.36 0.321 102.28%
q2 11.68 17.41 5.734 149.11%
q3 8.02 4.39 -3.629 54.73%
q4 64.22 63.67 -0.554 99.14%
q5 7.88 7.83 -0.049 99.37%
q6 3.93 4.33 0.401 110.21%
q7 5.92 6.31 0.395 106.67%
q8 5.42 5.15 -0.267 95.07%
q9 19.90 17.06 -2.841 85.72%
q10 12.01 11.81 -0.202 98.32%
q11 41.24 36.31 -4.930 88.04%
q12 2.55 2.74 0.193 107.57%
q13 5.45 6.44 0.996 118.28%
q14a 42.25 41.21 -1.039 97.54%
q14b 43.03 42.82 -0.212 99.51%
q15 2.58 2.74 0.164 106.37%
q16 38.32 38.75 0.431 101.13%
q17 4.98 4.69 -0.298 94.02%
q18 6.43 6.41 -0.014 99.79%
q19 2.33 3.24 0.905 138.80%
q20 1.26 1.37 0.105 108.36%
q21 1.01 4.09 3.078 404.78%
q22 11.50 7.99 -3.508 69.49%
q23a 81.39 84.91 3.521 104.33%
q23b 104.68 102.60 -2.083 98.01%
q24a 80.89 80.62 -0.264 99.67%
q24b 68.43 78.10 9.669 114.13%
q25 4.51 4.30 -0.205 95.45%
q26 4.20 2.64 -1.560 62.86%
q27 3.09 3.09 -0.005 99.84%
q28 29.89 23.43 -6.466 78.37%
q29 7.32 7.25 -0.073 99.00%
q30 4.59 4.23 -0.359 92.18%
q31 6.18 7.54 1.358 121.97%
q32 1.21 1.18 -0.036 97.03%
q33 4.79 4.77 -0.025 99.47%
q34 3.77 3.70 -0.068 98.19%
q35 6.55 8.88 2.330 135.57%
q36 3.38 3.50 0.115 103.39%
q37 5.47 4.04 -1.437 73.74%
q38 11.84 12.05 0.206 101.74%
q39a 3.33 4.14 0.814 124.43%
q39b 6.34 2.98 -3.358 47.04%
q40 3.65 4.71 1.057 128.98%
q41 0.62 0.57 -0.056 91.09%
q42 0.99 0.95 -0.047 95.28%
q43 3.59 5.56 1.976 155.11%
q44 8.75 8.92 0.170 101.94%
q45 3.54 3.56 0.022 100.62%
q46 3.16 3.22 0.059 101.86%
q47 14.59 14.40 -0.194 98.67%
q48 4.51 4.60 0.086 101.91%
q49 9.74 13.37 3.626 137.21%
q50 23.32 20.89 -2.427 89.59%
q51 8.58 8.48 -0.097 98.86%
q52 1.00 1.09 0.094 109.46%
q53 2.04 1.93 -0.113 94.49%
q54 3.29 3.23 -0.058 98.24%
q55 1.07 0.97 -0.102 90.51%
q56 4.35 4.60 0.256 105.90%
q57 8.58 8.59 0.013 100.15%
q58 2.63 2.51 -0.111 95.77%
q59 11.11 16.42 5.313 147.82%
q60 7.17 4.76 -2.405 66.45%
q61 5.36 5.36 -0.005 99.90%
q62 3.65 4.59 0.940 125.77%
q63 2.06 2.17 0.110 105.36%
q64 48.73 48.21 -0.525 98.92%
q65 14.57 15.52 0.951 106.52%
q66 5.78 3.47 -2.307 60.08%
q67 345.89 353.26 7.363 102.13%
q68 3.85 3.97 0.126 103.28%
q69 6.78 10.93 4.146 161.15%
q70 12.21 8.82 -3.389 72.25%
q71 2.54 2.25 -0.294 88.44%
q72 190.91 192.25 1.346 100.70%
q73 3.55 2.83 -0.716 79.81%
q74 21.47 21.44 -0.032 99.85%
q75 23.19 23.26 0.074 100.32%
q76 9.65 11.74 2.092 121.69%
q77 2.19 2.30 0.106 104.82%
q78 42.38 39.08 -3.302 92.21%
q79 3.57 3.45 -0.119 96.68%
q80 11.41 14.92 3.513 130.78%
q81 5.27 5.00 -0.271 94.85%
q82 10.28 6.85 -3.426 66.67%
q83 1.68 1.53 -0.152 90.96%
q84 2.90 2.76 -0.140 95.17%
q85 6.77 6.53 -0.235 96.53%
q86 4.89 3.28 -1.603 67.20%
q87 12.14 13.58 1.440 111.86%
q88 25.57 27.59 2.030 107.94%
q89 3.34 3.32 -0.021 99.37%
q90 9.41 4.50 -4.912 47.79%
q91 2.57 2.63 0.057 102.23%
q92 1.32 1.38 0.062 104.71%
q93 28.74 28.76 0.028 100.10%
q94 21.33 21.10 -0.237 98.89%
q9 84.11 82.75 -1.357 98.39%
q5 3.90 3.30 -0.596 84.71%
q96 12.63 12.36 -0.270 97.86%
q97 2.07 2.10 0.028 101.37%
q98 8.96 9.52 0.560 106.25%
q99 8.96 9.52 0.560 106.25%
total 1931.66 1937.03 5.375 100.28%

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_23_2024_1e06169cd_time.csv difference percentage
q1 35.62 36.88 1.261 103.54%
q2 23.39 23.65 0.262 101.12%
q3 38.98 42.16 3.184 108.17%
q4 31.35 33.05 1.704 105.44%
q5 72.14 69.90 -2.239 96.90%
q6 6.40 7.95 1.547 124.17%
q7 85.21 80.73 -4.487 94.73%
q8 86.28 82.15 -4.126 95.22%
q9 123.66 119.99 -3.672 97.03%
q10 46.46 46.07 -0.392 99.16%
q11 20.55 20.48 -0.068 99.67%
q12 25.16 26.53 1.374 105.46%
q13 40.24 38.12 -2.121 94.73%
q14 18.04 18.74 0.696 103.86%
q15 32.88 32.95 0.071 100.22%
q16 14.25 14.22 -0.025 99.82%
q17 105.91 104.72 -1.192 98.87%
q18 149.44 148.08 -1.357 99.09%
q19 13.84 14.64 0.804 105.81%
q20 32.02 30.40 -1.622 94.94%
q21 262.62 261.83 -0.792 99.70%
q22 12.33 12.33 0.008 100.07%
total 1276.76 1265.58 -11.184 99.12%

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_24_2024_f07e348f4_time.csv difference percentage
q1 36.11 35.39 -0.714 98.02%
q2 23.67 23.65 -0.021 99.91%
q3 41.11 40.35 -0.765 98.14%
q4 31.23 32.68 1.452 104.65%
q5 70.92 70.64 -0.278 99.61%
q6 10.62 9.08 -1.543 85.47%
q7 82.54 80.58 -1.960 97.63%
q8 85.16 87.90 2.738 103.21%
q9 119.05 125.50 6.449 105.42%
q10 47.31 48.85 1.541 103.26%
q11 20.21 20.45 0.240 101.19%
q12 27.09 26.51 -0.575 97.88%
q13 38.32 38.63 0.306 100.80%
q14 19.22 22.31 3.096 116.11%
q15 32.73 31.83 -0.898 97.26%
q16 14.56 14.13 -0.436 97.01%
q17 104.38 103.74 -0.644 99.38%
q18 149.05 144.47 -4.578 96.93%
q19 13.89 13.92 0.038 100.27%
q20 31.08 29.16 -1.919 93.83%
q21 262.60 264.29 1.696 100.65%
q22 12.11 12.24 0.122 101.01%
total 1272.95 1276.30 3.349 100.26%

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_6171_time.csv log/native_master_06_24_2024_f07e348f4d_time.csv difference percentage
q1 14.75 19.21 4.459 130.22%
q2 13.39 14.16 0.769 105.75%
q3 4.38 3.95 -0.431 90.15%
q4 63.58 62.97 -0.618 99.03%
q5 7.97 7.87 -0.101 98.74%
q6 3.53 2.50 -1.028 70.88%
q7 6.43 5.49 -0.944 85.33%
q8 5.85 5.08 -0.765 86.93%
q9 20.62 22.45 1.825 108.85%
q10 11.03 11.33 0.298 102.70%
q11 35.77 35.20 -0.564 98.42%
q12 1.46 1.47 0.013 100.92%
q13 9.13 5.37 -3.756 58.84%
q14a 41.45 43.48 2.021 104.88%
q14b 40.66 41.98 1.316 103.24%
q15 2.72 2.63 -0.086 96.85%
q16 38.15 38.68 0.532 101.39%
q17 4.84 7.38 2.546 152.61%
q18 7.35 6.61 -0.746 89.85%
q19 2.47 2.22 -0.247 89.97%
q20 1.51 2.59 1.080 171.35%
q21 1.12 1.18 0.059 105.24%
q22 9.73 9.87 0.132 101.36%
q23a 82.80 83.09 0.285 100.34%
q23b 102.59 100.62 -1.973 98.08%
q24a 73.92 73.78 -0.143 99.81%
q24b 78.93 67.56 -11.364 85.60%
q25 6.16 5.96 -0.201 96.74%
q26 3.22 2.94 -0.282 91.23%
q27 3.24 3.16 -0.072 97.79%
q28 26.29 24.23 -2.055 92.18%
q29 7.24 6.98 -0.265 96.34%
q30 4.06 4.33 0.267 106.57%
q31 6.22 7.92 1.706 127.45%
q32 1.10 1.03 -0.070 93.58%
q33 4.64 4.87 0.239 105.15%
q34 3.40 3.83 0.437 112.87%
q35 6.44 7.86 1.419 122.04%
q36 3.30 3.44 0.148 104.50%
q37 4.10 4.10 -0.003 99.93%
q38 11.75 11.63 -0.117 99.00%
q39a 3.52 3.22 -0.297 91.57%
q39b 3.15 5.12 1.972 162.68%
q40 3.54 3.92 0.380 110.75%
q41 0.60 0.60 -0.003 99.48%
q42 0.90 0.89 -0.008 99.15%
q43 3.54 3.73 0.189 105.33%
q44 8.95 8.56 -0.381 95.74%
q45 3.63 3.60 -0.035 99.05%
q46 3.24 3.37 0.131 104.05%
q47 14.50 14.18 -0.322 97.78%
q48 4.31 4.58 0.274 106.36%
q49 9.77 10.03 0.254 102.60%
q50 24.50 23.93 -0.563 97.70%
q51 8.52 8.64 0.123 101.44%
q52 0.99 1.05 0.057 105.74%
q53 1.97 2.03 0.060 103.04%
q54 3.33 3.21 -0.117 96.48%
q55 0.97 0.95 -0.016 98.31%
q56 4.37 4.37 0.002 100.06%
q57 9.15 8.62 -0.528 94.23%
q58 3.37 2.70 -0.675 79.98%
q59 14.95 13.99 -0.962 93.57%
q60 4.98 6.49 1.512 130.35%
q61 5.69 5.53 -0.169 97.03%
q62 4.40 4.80 0.397 109.03%
q63 2.34 2.28 -0.059 97.47%
q64 49.15 49.93 0.781 101.59%
q65 13.66 13.70 0.033 100.25%
q66 3.38 3.36 -0.015 99.57%
q67 344.15 350.98 6.830 101.98%
q68 3.89 3.69 -0.196 94.95%
q69 10.05 6.13 -3.919 61.00%
q70 9.37 11.04 1.661 117.71%
q71 2.31 3.07 0.757 132.75%
q72 188.59 191.38 2.797 101.48%
q73 2.21 2.72 0.516 123.38%
q74 23.69 21.09 -2.595 89.04%
q75 23.35 23.11 -0.238 98.98%
q76 9.42 9.27 -0.153 98.37%
q77 2.30 2.07 -0.233 89.91%
q78 42.89 43.31 0.423 100.99%
q79 3.65 3.43 -0.217 94.05%
q80 11.55 11.26 -0.293 97.46%
q81 5.17 5.05 -0.125 97.58%
q82 10.24 9.66 -0.582 94.31%
q83 1.49 1.61 0.126 108.47%
q84 2.86 2.67 -0.193 93.26%
q85 9.88 6.70 -3.179 67.82%
q86 3.23 3.29 0.064 101.98%
q87 11.97 12.25 0.278 102.33%
q88 25.23 24.67 -0.555 97.80%
q89 3.29 3.17 -0.119 96.38%
q90 7.76 10.11 2.347 130.22%
q91 2.57 2.68 0.101 103.94%
q92 1.25 1.30 0.050 103.95%
q93 28.92 28.82 -0.096 99.67%
q94 21.02 21.20 0.176 100.84%
q9 86.09 84.22 -1.873 97.82%
q5 3.43 3.49 0.055 101.62%
q96 12.29 12.33 0.037 100.30%
q97 2.04 1.94 -0.104 94.93%
q98 9.21 9.42 0.217 102.36%
q99 9.21 9.42 0.217 102.36%
total 1918.02 1915.52 -2.500 99.87%

@zhli1142015 zhli1142015 changed the title [DNR] test [DNR] test simd cmp Jun 27, 2024
@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

1 similar comment
@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCDS

@zhli1142015
Copy link
Contributor Author

/Benchmark Velox TPCH

@zhli1142015 zhli1142015 closed this Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zhli1142015 @GlutenPerfBot