Skip to content

If I don't want to use terngrad,does setting FLAGS.floating_grad_epoch=1 is all I need to do? #14

Open
@woskii

Description

@woskii

When I ran cifar10_alexnet on cifar10 dataset, I used terngrad and set FLAGS.floating_grad_epoch=0 (leave other arguments default), achieved top_1=86.04 after 300000 steps.
And then I want to see original accuracy without terngrad and set FLAGS.floating_grad_epoch=1,but I got top_1=85.64 after 300000 steps, which is not consistent with results in paper. I want to make sure that I used in a correct way.

By the way, if I want to test it on other models like densenet, what arguments should I modified? (weight decay? base lr?)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions