Skip to content

Commit

Permalink
[zero] remove misleading dtype log (microsoft#2732)
Browse files Browse the repository at this point in the history
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
  • Loading branch information
jeffra and tjruwase authored Jan 26, 2023
1 parent 30d3f5d commit a60e31a
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions deepspeed/runtime/engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -1524,8 +1524,7 @@ def _configure_zero_optimizer(self, optimizer):
round_robin_gradients = self.zero_round_robin_gradients()
assert not isinstance(optimizer, DummyOptim), "zero stage {} requires an optimizer".format(zero_stage)

log_dist('Creating fp16 ZeRO stage {} optimizer'.format(zero_stage),
ranks=[0])
log_dist('Creating ZeRO stage {} optimizer'.format(zero_stage), ranks=[0])
# Overlap and contiguous grads are meaningless in stage 1 and are ignored
if zero_stage == ZeroStageEnum.optimizer_states:
overlap_comm = False
Expand Down

0 comments on commit a60e31a

Please sign in to comment.