A training script comparing lars, lamb, adam and sgd by training 3 different resnets on cifar-10/100
Just run the train_comparison script after installing all depencies. Consider changing the batch_size
-
Notifications
You must be signed in to change notification settings - Fork 1
Comparing Adam, Lars, Lamb, SGD using CIFAR-10 and ResNet
License
AndreSoble/OptimizerComparisonCIFAR10
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Comparing Adam, Lars, Lamb, SGD using CIFAR-10 and ResNet
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published