You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
As of recent I've had stability problems with the wandb container. I narrowed it down to absurd memory usage of the mysqld:
On my system (Ryzen 1600, 32GB ram, Arch-linux) a bare wandb instance spawns dozens of mysql processes that in total take up 16GB+ or memory.
I was able to narrow it down to docker-library/mysql#579
In mysql.
I was able to confirm that the fix proposed there (running the container with --ulimit nofile=262144:262144 fixed the issue entirely (I still have a lot of mysqld processes, but they only take up a couple of mb in total).
Maybe consider adding this by default or document this as a known issue of mysqld so other people can find it?
The text was updated successfully, but these errors were encountered:
Hi,
As of recent I've had stability problems with the wandb container. I narrowed it down to absurd memory usage of the mysqld:
On my system (Ryzen 1600, 32GB ram, Arch-linux) a bare wandb instance spawns dozens of mysql processes that in total take up 16GB+ or memory.
I was able to narrow it down to
docker-library/mysql#579
In mysql.
I was able to confirm that the fix proposed there (running the container with
--ulimit nofile=262144:262144
fixed the issue entirely (I still have a lot of mysqld processes, but they only take up a couple of mb in total).Maybe consider adding this by default or document this as a known issue of mysqld so other people can find it?
The text was updated successfully, but these errors were encountered: