Commit 7f3b7dc
fix shardedtensor init (#2586)
Summary:
Pull Request resolved: #2586
we have global metadata for shardedtensor to use for init - we can avoid allgather altogether.
Reviewed By: kausv
Differential Revision: D66394789
fbshipit-source-id: 6edde29a711110f0588c5040db0e330d1b796d1b1 parent e6fe5de commit 7f3b7dc
1 file changed
+3
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
953 | 953 | | |
954 | 954 | | |
955 | 955 | | |
956 | | - | |
957 | | - | |
958 | | - | |
| 956 | + | |
| 957 | + | |
| 958 | + | |
959 | 959 | | |
960 | 960 | | |
961 | 961 | | |
| |||
0 commit comments