-
Notifications
You must be signed in to change notification settings - Fork 51
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Particles: Support Auto-Shape Counting #1374
Comments
attn @guj @franzpoeschel :) |
As a first step, we need to define the equivalent of Then we might need to disable a few shape checks in writing when this size is used (since it's max-size - N, this might not be needed; maybe we can also encode this as a state in the data type w/o magic constants). |
Since this feature is relevant for basically all parallel code that writes particles, we should (as a second step) implement this also in openPMD, so that those codes still stay compatible with HDF5. |
ADIOS2 now implements in the As a first step, we need to support this in the shape of our |
A challenge will be the support for particle patches. |
For particles, we need to investigate how we can deine openPMD Datatyopes that have only a local size, where their global size is determined at runtime.
This currently would only work with ADIOS2 2.9+ using
JoinedArrays
and would safe users from having to do collective All2All comms (reduce sum and a scan) for particle global sizes and offsets prior to I/O.Related to: ornladios/ADIOS2#3452
The text was updated successfully, but these errors were encountered: