Code

Add API for updating ZeRO gradients#6590

Code

Merged

tohtana merged 8 commits intomastermicrosoft/DeepSpeed:masterfrom olruwase/set_zero_opt_gradmicrosoft/DeepSpeed:olruwase/set_zero_opt_gradCopy head branch name to clipboardOct 14, 2024

+211-85

Commits

Commits on Sep 29, 2024

• Add API for updating ZeRO gradients

  tjruwase

  committed
  18ee6cf

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  6110f70

• Update docs

  tjruwase

  committed
  c589284

Commits on Sep 30, 2024

• Format fix

  tjruwase

  committed
  e88cad9

Commits on Oct 7, 2024

• Update docs; Improve DS logging consistency

  tjruwase

  committed
  1fde1f3

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  55b558e

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  021dc0a

Commits on Oct 8, 2024

• Merge branch 'master' into olruwase/set_zero_opt_grad

  tjruwase

  authored
  5372ee6