From 711d4fe8132c3cdd70c3230997189d1b87c695de Mon Sep 17 00:00:00 2001 From: Sundeep Gottipati <42554856+bananabowl@users.noreply.github.com> Date: Wed, 24 Jul 2019 13:15:25 -0700 Subject: [PATCH] Mention other default learning rate changes in 1.14 relnotes --- RELEASE.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/RELEASE.md b/RELEASE.md index cc0d3e6aaee..debbba723dd 100644 --- a/RELEASE.md +++ b/RELEASE.md @@ -43,7 +43,11 @@ * Transitive dependencies on :pooling_ops were removed. Some users may need to add explicit dependencies on :pooling_ops if they reference the operators from that library. -* tf.keras.optimizers.Adadelta default learning rate changed from 1.0 to .001 +* tf.keras.optimizers default learning rate changes: + * Adadelta: 1.000 to 0.001 + * Adagrad: 0.01 to 0.001 + * Adamax: 0.002 to 0.001 + * NAdam: 0.002 to 0.001 ## Bug Fixes and Other Changes