Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-6923][CH] total_bytes_written is not updated in celeborn partition writers #6939

Merged
merged 3 commits into from
Aug 21, 2024

Conversation

lgbo-ustc
Copy link
Contributor

@lgbo-ustc lgbo-ustc commented Aug 20, 2024

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

Fixes: #6923

AQE has dependency on shuffle written bytes to generate a proper plan.

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

manual tests

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

@baibaichen
Copy link
Contributor

能加 UT 吗?

@lgbo-ustc
Copy link
Contributor Author

能加 UT 吗?

这要用到celeborn,现在没有集成测试,加不了吧

liuneng1994
liuneng1994 previously approved these changes Aug 20, 2024
Copy link
Contributor

@liuneng1994 liuneng1994 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@baibaichen
Copy link
Contributor

Run Gluten Clickhouse CI

Copy link

#6923

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

2 similar comments
Copy link

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

@lgbo-ustc lgbo-ustc force-pushed the 6923_1 branch 2 times, most recently from 9f8c622 to 2cd649e Compare August 20, 2024 11:20
@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

4 similar comments
@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

3 similar comments
Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

1 similar comment
Copy link

Run Gluten Clickhouse CI

Copy link

Run Gluten Clickhouse CI

1 similar comment
@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse CI

@lgbo-ustc lgbo-ustc force-pushed the 6923_1 branch 2 times, most recently from 9fd6642 to 0f41120 Compare August 21, 2024 03:06
Copy link

Run Gluten Clickhouse CI

1 similar comment
Copy link

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse C

Copy link

Run Gluten Clickhouse CI

@lgbo-ustc
Copy link
Contributor Author

Run Gluten Clickhouse C

Copy link

Run Gluten Clickhouse CI

Copy link
Contributor

@liuneng1994 liuneng1994 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@liuneng1994 liuneng1994 merged commit 6314456 into apache:main Aug 21, 2024
8 checks passed
sharkdtu pushed a commit to sharkdtu/gluten that referenced this pull request Nov 11, 2024
…rtition writers (apache#6939)

What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)

Fixes: apache#6923

AQE has dependency on shuffle written bytes to generate a proper plan.

How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

manual tests

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CH] Broadcast join stuck
4 participants