Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-7023][CH] Shade dependency jars #7027

Merged
merged 2 commits into from
Sep 9, 2024

Conversation

loudongfeng
Copy link
Contributor

What changes were proposed in this pull request?

Shade clickhouse backend dependency jars

Fixes: #7023

How was this patch tested?

Manual verification by running basic queries.

Copy link

#7023

Copy link

Run Gluten Clickhouse CI

zzcclp
zzcclp previously approved these changes Aug 29, 2024
Copy link
Contributor

@zzcclp zzcclp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@baibaichen
Copy link
Contributor

@loudongfeng hold on let's review it

@lwz9103
Copy link
Contributor

lwz9103 commented Aug 29, 2024

It seems that some Google libraries have been shaded into the Gluten jar. Does this mean we no longer need to copy the google protobuf jar to Spark? If so, please help modify the ep/build-clickhouse/src/package.sh to remove downloading protobuf jar.

image

Copy link

Run Gluten Clickhouse CI

@loudongfeng
Copy link
Contributor Author

It seems that some Google libraries have been shaded into the Gluten jar. Does this mean we no longer need to copy the google protobuf jar to Spark? If so, please help modify the ep/build-clickhouse/src/package.sh to remove downloading protobuf jar.

Fixed. Also updated the document file.

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

github-actions bot commented Sep 9, 2024

Run Gluten Clickhouse CI

@lwz9103
Copy link
Contributor

lwz9103 commented Sep 9, 2024

LGTM

Copy link
Contributor

@baibaichen baibaichen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@baibaichen baibaichen merged commit cc78e17 into apache:main Sep 9, 2024
6 checks passed
dcoliversun pushed a commit to dcoliversun/gluten that referenced this pull request Sep 11, 2024
* [GLUTEN-7023][CH] Shade dependency jars

* [GLUTEN-7023][CH] Shade dependency jars(update pacakge script and getstart doc)
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
* [GLUTEN-7023][CH] Shade dependency jars

* [GLUTEN-7023][CH] Shade dependency jars(update pacakge script and getstart doc)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CH]shade dependency jars
4 participants