You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am working on a distributed simulation where N computing nodes exchange unstructured grid data using MPI. Currently, at each iteration, the updated data is written to a common output file in HDF5.
Now, I would like to introduce M staging nodes dedicated to I/O and analytics. The goal is to have the N computing nodes communicate their unstructured grid data to a middleware, which then redistributes it to the M staging nodes. At each iteration, computing nodes should update the staging nodes with their new data, which is then further redistributed to the M analytics nodes.
The unstructured grid consists of both cell-centered and point-centered data, which can be scalar or vectorial. I would like to know if ADIOS2 currently supports this workflow, or if there are existing examples demonstrating a similar use case.
Use Case and Requirements
When simulation starts, the computing nodes share a global unstructured mesh, which is partitioned across them using our own library (or potentially via Scotch).
-Each computing node needs to send its partial graph description (mesh connectivity, points, and cells) to ADIOS2.
ADIOS2 should reconstruct the graph and redistribute it to M analytics nodes.
During each iteration, computing nodes send their updated cell and point data (including scalar and vector fields) to ADIOS2.
ADIOS2 then redistributes the required data to the analytics nodes.
Does the current release of ADIOS2 support this workflow?
If yes, are there existing examples in the repository demonstrating a similar implementation?
I have come across implementations that use VTK.xml to store graph and mesh information for visualization. (https://adios2.readthedocs.io/en/latest/ecosystem/visualization.html)
-Can this approach be used to facilitate graph exchange, reconstruction and redistribution in ADIOS2?
-Are there any available examples of such an implementation?
The text was updated successfully, but these errors were encountered:
I am working on a distributed simulation where N computing nodes exchange unstructured grid data using MPI. Currently, at each iteration, the updated data is written to a common output file in HDF5.
Now, I would like to introduce M staging nodes dedicated to I/O and analytics. The goal is to have the N computing nodes communicate their unstructured grid data to a middleware, which then redistributes it to the M staging nodes. At each iteration, computing nodes should update the staging nodes with their new data, which is then further redistributed to the M analytics nodes.
The unstructured grid consists of both cell-centered and point-centered data, which can be scalar or vectorial. I would like to know if ADIOS2 currently supports this workflow, or if there are existing examples demonstrating a similar use case.
Use Case and Requirements
-Each computing node needs to send its partial graph description (mesh connectivity, points, and cells) to ADIOS2.
-Can this approach be used to facilitate graph exchange, reconstruction and redistribution in ADIOS2?
-Are there any available examples of such an implementation?
The text was updated successfully, but these errors were encountered: