Commit 9e744df
add DTensor to VLE and fix 2D sharding group in EBC (#2626)
Summary:
Adding DTensor state dict to VLE, this is identical to EBC DTensor path.
Future work of this diff is to consolidate the logic of EBC/PEA/VLE state dict into one parent class because of their significant similarities
A revert diff removed the 2D sharding logic in embedding bag collection mistakenly: D66800554, this diff adds it back in
Differential Revision: D655555951 parent 65387d3 commit 9e744df
1 file changed
+6
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
| 68 | + | |
68 | 69 | | |
69 | 70 | | |
70 | 71 | | |
| |||
938 | 939 | | |
939 | 940 | | |
940 | 941 | | |
941 | | - | |
| 942 | + | |
| 943 | + | |
| 944 | + | |
| 945 | + | |
| 946 | + | |
942 | 947 | | |
943 | 948 | | |
944 | 949 | | |
| |||
0 commit comments