Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement HLG layer for P2P rechunking #8751

Merged
merged 14 commits into from
Jul 18, 2024
Merged

Implement HLG layer for P2P rechunking #8751

Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
184dbd5
Add HLG for rechunking (WIP)
hendrikmakait Jul 5, 2024
9bd1f60
Improve culling (WIP)
hendrikmakait Jul 5, 2024
68d4404
Improved culling
hendrikmakait Jul 5, 2024
f20b847
Add reproducer
hendrikmakait Jul 5, 2024
044f268
comments
hendrikmakait Jul 5, 2024
a8022a3
Fix partial concatenation with culling
hendrikmakait Jul 17, 2024
9c820b7
Merge branch 'main' into p2p-rechunking-hlg
hendrikmakait Jul 17, 2024
d816b8a
Calculate old_to_new once
hendrikmakait Jul 17, 2024
ded769e
only return output keys for non-culled outputs
hendrikmakait Jul 17, 2024
d3f2378
Move import
hendrikmakait Jul 17, 2024
c11490d
Remove unused kwarg
hendrikmakait Jul 17, 2024
6c7bfba
Review
hendrikmakait Jul 17, 2024
5acce0a
Update distributed/shuffle/tests/test_rechunk.py
hendrikmakait Jul 17, 2024
3703897
Merge branch 'main' into p2p-rechunking-hlg
hendrikmakait Jul 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading