-
-
Notifications
You must be signed in to change notification settings - Fork 5k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
The recently introduced [Muon Optimizer](https://github.com/KellerJordan/Muon) has shown promising results, claiming to outperform commonly used optimizers such as AdamW, Shampoo, and SOAP ([reference benchmarks](https://github.com/KellerJordan/modded-nanogpt/tree/master/records/102924_Optimizers)).
Given its potential advantages, it would be valuable to have Muon integrated into the timm
library for broader experimentation and adoption.
Is there any plan or interest in adding support for Muon Optimizer to timm
?
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request