Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CELEBORN] Fix Celeborn support of get-started document #6282

Merged
merged 2 commits into from
Jul 1, 2024

Conversation

SteNicholas
Copy link
Member

What changes were proposed in this pull request?

Fix Celeborn support of get-started document including:

  1. Use -Pceleborn to fix the profile of celeborn in Maven build parameters for build-guide.md.
  2. Use -Pceleborn to fix the profile of compiling the Gluten Java module in Celeborn support for Velox.md.
  3. Fix and improvement Celeborn support of clickhouse backend for ClickHouse.md.

How was this patch tested?

No.

Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@SteNicholas
Copy link
Member Author

@taiyang-li
Copy link
Contributor

@zzcclp can you also review it ?

@SteNicholas
Copy link
Member Author

@taiyang-li, I have addressed above comments. PTAL. cc @zzcclp.

@SteNicholas SteNicholas requested a review from taiyang-li July 1, 2024 06:57
Copy link
Contributor

@taiyang-li taiyang-li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kerwin-zk kerwin-zk merged commit c5ce552 into apache:main Jul 1, 2024
3 checks passed
kerwin-zk pushed a commit to apache/celeborn that referenced this pull request Jul 1, 2024
### What changes were proposed in this pull request?

Introduce `ClickHouse Backend` in `Gluten Support` document. Meanwhile, fix the profile via `-Pceleborn` to compile gluten module.

### Why are the changes needed?

Gluten with ClickHouse backend supports Celeborn as remote shuffle service at present. Gluten Support document should introduce ClickHouse Backend to guide user usage of Gluten with ClickHouse backend.

Backport apache/incubator-gluten#6282.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

No.

Closes #2594 from SteNicholas/CELEBORN-1486.

Authored-by: SteNicholas <[email protected]>
Signed-off-by: xiyu.zk <[email protected]>
kerwin-zk pushed a commit to apache/celeborn that referenced this pull request Jul 1, 2024
### What changes were proposed in this pull request?

Introduce `ClickHouse Backend` in `Gluten Support` document. Meanwhile, fix the profile via `-Pceleborn` to compile gluten module.

### Why are the changes needed?

Gluten with ClickHouse backend supports Celeborn as remote shuffle service at present. Gluten Support document should introduce ClickHouse Backend to guide user usage of Gluten with ClickHouse backend.

Backport apache/incubator-gluten#6282.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

No.

Closes #2594 from SteNicholas/CELEBORN-1486.

Authored-by: SteNicholas <[email protected]>
Signed-off-by: xiyu.zk <[email protected]>
(cherry picked from commit 5a39fc7)
Signed-off-by: xiyu.zk <[email protected]>
kerwin-zk pushed a commit to apache/celeborn that referenced this pull request Jul 1, 2024
### What changes were proposed in this pull request?

Introduce `ClickHouse Backend` in `Gluten Support` document. Meanwhile, fix the profile via `-Pceleborn` to compile gluten module.

### Why are the changes needed?

Gluten with ClickHouse backend supports Celeborn as remote shuffle service at present. Gluten Support document should introduce ClickHouse Backend to guide user usage of Gluten with ClickHouse backend.

Backport apache/incubator-gluten#6282.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

No.

Closes #2594 from SteNicholas/CELEBORN-1486.

Authored-by: SteNicholas <[email protected]>
Signed-off-by: xiyu.zk <[email protected]>
(cherry picked from commit 5a39fc7)
Signed-off-by: xiyu.zk <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants