Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

decl'hdf5 feature: posibility to choose at low level of HDF5 (independent or collective) #491

Open
jmorice91 opened this issue Oct 24, 2024 · 1 comment · May be fixed by #502
Open

decl'hdf5 feature: posibility to choose at low level of HDF5 (independent or collective) #491

jmorice91 opened this issue Oct 24, 2024 · 1 comment · May be fixed by #502

Comments

@jmorice91
Copy link
Contributor

For more details see section "Low-level collective vs. independent I/O" in the webpage:
https://github.com/HDFGroup/hdf5/blob/develop/doc/parallel-compression.md

After the choice of mpio pointer (collective of independent) with the following code:

H5Pset_dxpl_mpio(dxpl_id, H5FD_MPIO_COLLECTIVE)

line 291 of "file_op.cxx" in main.

We want to add the possibility to use the "low level independent I/O" in adding this line:

H5Pset_dxpl_mpio_collective_opt(dxpl_id, H5FD_MPIO_INDIVIDUAL_IO); /* Try independent I/O */

The second argument can be H5FD_MPIO_INDIVIDUAL_IO or H5FD_MPIO_COLLECTIVE_IO.
This parameter is collective by default.

@jbigot
Copy link
Member

jbigot commented Oct 30, 2024

Seems to be related to parallel compression. I don't think we expose it in Decl'HDF5 yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants