Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gflag to allow growing buffers that were created in different task #10768

Closed

Conversation

zhztheplayer
Copy link
Contributor

@zhztheplayer zhztheplayer commented Aug 16, 2024

Add a global bool flag FLAGS_transferred_arbitration_allowed (by default false), when it is set to true, Velox will allow growing a buffer that was created in a different task.

This could fix Gluten issue apache/incubator-gluten#6864.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 16, 2024
Copy link

netlify bot commented Aug 16, 2024

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit f1db1dd
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/66c2c77d8a77160008a13cf2

@zhztheplayer zhztheplayer changed the title [VL] New global flag to allow growing buffers that were created from different task [VL] New global flag to allow growing buffers that were created in different task Aug 16, 2024
@zhztheplayer zhztheplayer marked this pull request as ready for review August 16, 2024 08:50
@zhztheplayer
Copy link
Contributor Author

@xiaoxmeng thanks

@Yuhta Yuhta requested a review from xiaoxmeng August 16, 2024 14:15
Copy link
Contributor

@xiaoxmeng xiaoxmeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhztheplayer LGTM and can you add a test on this gflag? Thanks!

velox/exec/MemoryReclaimer.cpp Outdated Show resolved Hide resolved
velox/exec/MemoryReclaimer.cpp Outdated Show resolved Hide resolved
Copy link
Contributor

@xiaoxmeng xiaoxmeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhztheplayer LGTM. Thanks!

@facebook-github-bot
Copy link
Contributor

@xiaoxmeng has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@xiaoxmeng xiaoxmeng changed the title [VL] New global flag to allow growing buffers that were created in different task Add gflag to allow growing buffers that were created in different task Aug 19, 2024
@facebook-github-bot
Copy link
Contributor

@xiaoxmeng has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@xiaoxmeng merged this pull request in 676b170.

Copy link

Conbench analyzed the 1 benchmark run on commit 676b1701.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants