New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

xarray consumes a lot of memory #29

Open

joernu76 opened this issue Feb 22, 2022 · 0 comments

Member

joernu76 commented Feb 22, 2022

The current implementation of xarray loads the whole dataset in memory, which can be very large depending on the gridding, area and time steps.

a lazy-loading implementation (open_dataset) or an implementation modifying the file in place (netCDF4) would be preferable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment