Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Make conf option s.g.s.c.shuffledHashJoin.optimizeBuildSide work correctly with option s.g.s.c.forceShuffledHashJoin #7186

Merged
merged 10 commits into from
Sep 11, 2024

Conversation

zhztheplayer
Copy link
Member

Currently when s.g.s.c.shuffledHashJoin.optimizeBuildSide==false and s.g.s.c.forceShuffledHashJoin=true, SMJ will be converted to SHJ with a randomly chosen build side. This PR fixes the issue by choosing a smaller one in RewriteJoin rule.

@github-actions github-actions bot added the CORE works for Gluten Core label Sep 10, 2024
@apache apache deleted a comment from github-actions bot Sep 10, 2024
Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link
Contributor

@rui-mo rui-mo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Perhaps remove the prefix 's.g.s.c.' from the title, as it might bring confusion.

@zhztheplayer
Copy link
Member Author

Thanks. Perhaps remove the prefix 's.g.s.c.' from the title, as it might bring confusion.

Thanks although I found it's an easy way to represent a config option in title. Or if you have better suggestions? Like shuffledHashJoin.optimizeBuildSide / forceShuffledHashJoin?

@zhztheplayer zhztheplayer changed the title [VL] Make s.g.s.c.shuffledHashJoin.optimizeBuildSide work correctly with s.g.s.c.forceShuffledHashJoin [VL] Make conf option s.g.s.c.shuffledHashJoin.optimizeBuildSide work correctly with option s.g.s.c.forceShuffledHashJoin Sep 11, 2024
@zhztheplayer zhztheplayer merged commit 73100f4 into apache:main Sep 11, 2024
45 checks passed
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
…rk correctly with option `s.g.s.c.forceShuffledHashJoin` (apache#7186)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CORE works for Gluten Core
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants