Closed
Description
All optimizers require the one-time initialization of some tensors like learning rate, accumulators etc. Currently we initialize them using fill_constant
op, which is not correct. Once the new initialization design (#4852) is implemented, we need to change the initialization in optimizers.py.
Metadata
Metadata
Assignees
Labels
No labels