Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-3983][CORE] Shade Guava dependency #3984

Merged
merged 3 commits into from
Dec 12, 2023

Conversation

zwangsheng
Copy link
Contributor

What changes were proposed in this pull request?

Shaded Guava in gluten-package

Fixs: #3983

How was this patch tested?

Local Package Test

mvn clean package -Pbackends-velox -Pspark-3.3 -Prss -DskipTests

Copy link

github-actions bot commented Dec 8, 2023

#3983

Copy link

github-actions bot commented Dec 8, 2023

Run Gluten Clickhouse CI

@PHILO-HE PHILO-HE changed the title [GLUTEN-3983][CORE] Shaded Guava dependency [GLUTEN-3983][CORE] Shade Guava dependency Dec 12, 2023
@PHILO-HE
Copy link
Contributor

@zwangsheng, thanks for your fix! Please rebase the code to fix red CI.

</excludes>
</relocation>
<relocation>
<pattern>com.google.thirdparty</pattern>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also shade com.google.j2objc and com.google.gson ? I saw the Spark connect Server module shade these things and I think it's reasonable.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, i'll do rebase and shade those.

Copy link

Run Gluten Clickhouse CI

@zwangsheng
Copy link
Contributor Author

Hi @PHILO-HE @ulysses-you , rebased and continue shade errorprone.annotations, j2objc, gson based on spark connect server pom.xml. PTAL

Copy link

Run Gluten Clickhouse CI

@ulysses-you ulysses-you requested a review from PHILO-HE December 12, 2023 10:04
Copy link
Contributor

@PHILO-HE PHILO-HE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@ulysses-you ulysses-you merged commit 0ba0801 into apache:main Dec 12, 2023
17 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_3984_time.csv log/native_master_12_11_2023_71ec720d4_time.csv difference percentage
q1 34.20 32.10 -2.099 93.86%
q2 25.02 24.79 -0.227 99.09%
q3 38.54 38.42 -0.123 99.68%
q4 37.27 39.90 2.631 107.06%
q5 71.58 72.41 0.829 101.16%
q6 5.46 7.02 1.551 128.38%
q7 86.48 85.38 -1.102 98.73%
q8 84.79 86.65 1.859 102.19%
q9 121.68 126.76 5.079 104.17%
q10 44.57 46.79 2.216 104.97%
q11 20.03 20.34 0.316 101.58%
q12 26.32 26.95 0.626 102.38%
q13 46.17 45.56 -0.607 98.68%
q14 19.93 18.31 -1.621 91.87%
q15 27.09 27.78 0.686 102.53%
q16 15.42 15.83 0.406 102.63%
q17 102.29 101.57 -0.715 99.30%
q18 151.61 151.54 -0.067 99.96%
q19 12.69 12.91 0.212 101.67%
q20 28.03 26.84 -1.197 95.73%
q21 226.92 228.06 1.147 100.51%
q22 14.07 13.81 -0.262 98.14%
total 1240.17 1249.71 9.538 100.77%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants