Skip to content

Conversation

wanghaoshuang
Copy link
Contributor

fix #9212


class AdadeltaOptimizer(Optimizer):
"""Simple Adadelta optimizer with average squared grad state and
average squared update state.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

def __init__(self, learning_rate, epsilon=1.0e-6, rho=0.95, **kwargs):
assert learning_rate is not None
assert epsilon is not None
assert rho is not None
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better to use raise not assert.

Copy link
Contributor

@qingqing01 qingqing01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@wanghaoshuang wanghaoshuang merged commit 7e526a6 into PaddlePaddle:develop Mar 20, 2018
@wanghaoshuang wanghaoshuang deleted the adadelta branch March 20, 2018 06:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add python wrapper for Adadelta optimizer

2 participants