[Draft] Muon Optimizer Support for ZeRO3#7798

Open

PKUWZP wants to merge 13 commits intodeepspeedai:masterfrom

pengdurice:peng-add-muon-stage3

Commits on Nov 23, 2025

initial commits: fix import error and rename the stage1and2 clss
pengdurice
committed

Commits on Nov 28, 2025

save for now before rebase
pengdurice
committed
Merge branch 'master' into peng-add-muon-stage3
pengdurice
committed
save for now, need to handle how to write the momentum back as well as non continguous version + test + everything else
pengdurice
committed

Commits on Dec 1, 2025

Commits on Dec 3, 2025

remove float() and rename the variables
pengdurice
committed

Commits on Dec 6, 2025