Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-3668][CH] Performance regresses seriously after PR 3169 merge when executing convert string to date #3671

Merged
merged 1 commit into from
Nov 10, 2023

Conversation

zzcclp
Copy link
Contributor

@zzcclp zzcclp commented Nov 10, 2023

What changes were proposed in this pull request?

PR #3169 add some functions to convert string to date, which leads to performance regression serious. Will be reverted first and raise another pr to fix the issue later.

Test case, 2000W records:
before PR #3169 : 3s
after PR #3169: 3.6m

Related PR: #3169, #3563;

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

… when executing convert string to date

PR apache#3169 add some functions to convert string to date, which leads to performance regression serious.
Will be reverted first and raise another pr to fix the issue later.

Test case, 2000W records:
before PR apache#3169 : 3s
after PR apache#3169: 3.6m

Related PR: apache#3169, apache#3563;
Copy link

#3668

Copy link

Run Gluten Clickhouse CI

@zzcclp
Copy link
Contributor Author

zzcclp commented Nov 10, 2023

@KevinyhZou @lgbo-ustc @taiyang-li please help to review, thanks.

@lgbo-ustc
Copy link
Contributor

LGTM

@zzcclp zzcclp merged commit bd483c9 into apache:main Nov 10, 2023
6 checks passed
lwz9103 pushed a commit that referenced this pull request Nov 10, 2023
… when executing convert string to date (#3671)

PR #3169 add some functions to convert string to date, which leads to performance regression serious.
Will be reverted first and raise another pr to fix the issue later.

Test case, 2000W records:
before PR #3169 : 3s
after PR #3169: 3.6m

Related PR: #3169, #3563;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants