Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-4218] fix: Fix Gluten CPP build breaks #4217

Merged
merged 1 commit into from
Jan 9, 2024

Conversation

Surbhi-Vijay
Copy link
Contributor

@Surbhi-Vijay Surbhi-Vijay commented Dec 28, 2023

What changes were proposed in this pull request?

This PR fixes below two build issues:

  1. While building gluten cpp with vcpkg, build is breaking with below error:

image

Adding "thrift" to dev/vcpkg/vcpkg.json dependencies resolves the issue.

(Fixes: #4218)

How was this patch tested?

Build passes after the fixes

Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@Surbhi-Vijay Surbhi-Vijay changed the title Fix Gluten CPP build breaks [GLUTEN-${4218}]fix: ${Fix Gluten CPP build breaks} Dec 28, 2023
@Surbhi-Vijay Surbhi-Vijay changed the title [GLUTEN-${4218}]fix: ${Fix Gluten CPP build breaks} [GLUTEN-4218] fix: Fix Gluten CPP build breaks Dec 28, 2023
@zhouyuan
Copy link
Contributor

zhouyuan commented Jan 2, 2024

@Surbhi-Vijay thanks for fixing, it's a little odd as we do have a GitHub action test for static building(centos 7 based) to check each commit, could you please share a bit on your building env?

@Surbhi-Vijay
Copy link
Contributor Author

@Surbhi-Vijay thanks for fixing, it's a little odd as we do have a GitHub action test for static building(centos 7 based) to check each commit, could you please share a bit on your building env?

@zhouyuan I am compiling gluten and velox with vcpkg by following the commands below on Ubuntu 22.04.3 LTS

sudo -E ./dev/vcpkg/setup-build-depends.sh
source ./dev/vcpkg/env.sh

./build_velox.sh --build_type=Debug

cmake -DBUILD_VELOX_BACKEND=ON -DVELOX_HOME=/home/surbhi/work/repos/OSS/gluten/ep/build-velox/build/velox_ep -DARROW_HOME=/home/surbhi/work/repos/OSS/gluten/ep/build-velox/build/velox_ep/_build/debug/third_party/arrow_ep -DCMAKE_BUILD_TYPE=Debug ..

mvn install spotless:apply -Pbackends-velox -Prss -Pspark-3.3 -Pspark-ut -DskipTests

@gaoyangxiaozhu
Copy link
Contributor

gaoyangxiaozhu commented Jan 7, 2024

@Surbhi-Vijay thanks for fixing, it's a little odd as we do have a GitHub action test for static building(centos 7 based) to check each commit, could you please share a bit on your building env?

hey @zhouyuan , this is the issue we encoutnered after last sync and we fix by add thrift in VCPKG.json

@Surbhi-Vijay Surbhi-Vijay force-pushed the suvijayv/Fix_build branch 2 times, most recently from 61c5487 to f26c102 Compare January 8, 2024 04:48
@zhouyuan
Copy link
Contributor

zhouyuan commented Jan 8, 2024

@Surbhi-Vijay can you please do a rebase? the failure on boost download should be fixed now

thanks, -yuan

Copy link
Contributor

@zhouyuan zhouyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@zhouyuan zhouyuan merged commit d601da5 into apache:main Jan 9, 2024
17 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_4217_time.csv log/native_master_01_08_2024_b81ecdef1_time.csv difference percentage
q1 33.44 33.20 -0.242 99.28%
q2 25.62 25.74 0.119 100.47%
q3 37.96 38.04 0.078 100.20%
q4 39.28 39.01 -0.269 99.31%
q5 70.63 71.87 1.248 101.77%
q6 7.04 8.18 1.139 116.19%
q7 87.14 85.51 -1.632 98.13%
q8 86.37 85.98 -0.389 99.55%
q9 127.70 122.63 -5.071 96.03%
q10 43.83 43.71 -0.123 99.72%
q11 19.64 20.14 0.496 102.52%
q12 25.74 27.54 1.792 106.96%
q13 46.09 46.35 0.262 100.57%
q14 16.20 18.04 1.843 111.38%
q15 28.31 28.07 -0.240 99.15%
q16 15.39 15.33 -0.062 99.60%
q17 160.25 157.40 -2.848 98.22%
q18 195.36 196.16 0.798 100.41%
q19 16.57 16.55 -0.017 99.90%
q20 28.71 29.10 0.387 101.35%
q21 227.59 226.46 -1.132 99.50%
q22 13.93 14.01 0.082 100.59%
total 1352.79 1349.01 -3.783 99.72%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Gluten CPP build breaks
5 participants