Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[stable28] perf(ObjectStoreStorage): Improve (slow) move on same object bucket #48985

Merged
merged 2 commits into from
Oct 31, 2024

Conversation

backportbot[bot]
Copy link

@backportbot backportbot bot commented Oct 29, 2024

Backport of PR #47986

This commit fixes the issue #47856. When you upload a file into a group folder and when you use a single S3 bucket as primary storage, the final move operation hangs for a long time. In the background, Nextcloud initiates a copy-delete sequence from the bucket into the bucket, with causes a lot unnecessary overhead. Nextcloud thinks that the file must be imported to another storage and does not recognize that everything is done on the same object bucket. In that case, the import step can be completely skipped, which saves time, network bandwidth and reduces the load on the object storage.

The behavior improves a lot with #46013. However, there are still some put messages that are being sent to the object storage when you use an object storage as primary storage and upload files into a group folder.

Co-authored-by: Kate <[email protected]>
Signed-off-by: Christoph Fiehe <[email protected]>
Copy link
Member

@provokateurin provokateurin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wait for discussion in original PR

Copy link
Member

@provokateurin provokateurin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's broken

@Altahrim Altahrim mentioned this pull request Oct 30, 2024
2 tasks
@Altahrim Altahrim marked this pull request as draft October 31, 2024 08:36
Some are still failing

Signed-off-by: Côme Chilliet <[email protected]>
Copy link
Contributor

@artonge artonge left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cherry-picked the tests fixed from cfca7e7

@artonge artonge marked this pull request as ready for review October 31, 2024 14:12
Copy link
Member

@provokateurin provokateurin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tests are happy, then I'm happy as well 🤷‍♀️

@artonge artonge enabled auto-merge October 31, 2024 14:26
@artonge artonge merged commit 64583a0 into stable28 Oct 31, 2024
59 checks passed
@artonge artonge deleted the backport/47986/stable28 branch October 31, 2024 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants