Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory consumption #257

Open
lucianolorenti opened this issue May 1, 2019 · 1 comment
Open

Memory consumption #257

lucianolorenti opened this issue May 1, 2019 · 1 comment

Comments

@lucianolorenti
Copy link

lucianolorenti commented May 1, 2019

Hello. When I load multiple JLD files, the data is not garbage collected causing memory exhaustion.

For instance, the following code keeps rising memory consumption. Is this related to HDF5.jl # 349 or could be something else?

using JLD
save("myfile.jld", "t", rand(5000, 3))
for i = 1:50000
    c = jldopen("/home/lucaino/myfile.jld", "r") do file
        read(file, "t")
    end
end

I am using Archlinux. Julia 1.1.0. JLD v0.9.1, HDF5 v0.11.1

@lucianolorenti lucianolorenti changed the title Memory consuption Memory consumption May 1, 2019
@aramirezreyes
Copy link

I think I am looking at something similar that leads to OutOfMemoryError, will need to continue experimenting but I would be glad to see if someone sees similar.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants