Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FE Proxy] Get No space left on device error when streaming load data #549

Open
yandongxiao opened this issue Jun 21, 2024 · 0 comments
Open
Labels
bug Something isn't working

Comments

@yandongxiao
Copy link
Collaborator

Describe the bug

For safety reasons, cloud service providers will limit the maximum disk space each Pod can use, such as 100GB. When the files for Stream Load are very large, for example, when conducting a 1TB tpch test, if we load 38GB of data at one time with 5 concurrent operations, it will cause Nginx to report an error: "no space left on device."

image

Additionally, increasing the number of copies is also not feasible, as the storage space of the container's root directory is shared among multiple containers.

Expected behavior

FE Proxy support mount volumes on /tmp directory.

Please complete the following information

  • Operator Version: v1.9.6
@yandongxiao yandongxiao added the bug Something isn't working label Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant