Mention other default learning rate changes in 1.14 relnotes

huangjin1995 · Jul 24, 2019 · 711d4fe · 711d4fe
1 parent f81646a
commit 711d4fe
Showing 1 changed file with 5 additions and 1 deletion.
diff --git a/RELEASE.md b/RELEASE.md
@@ -43,7 +43,11 @@
 *   Transitive dependencies on :pooling_ops were removed. Some users may need to
     add explicit dependencies on :pooling_ops if they reference the operators
     from that library.
-*   tf.keras.optimizers.Adadelta default learning rate changed from 1.0 to .001
+*   tf.keras.optimizers default learning rate changes:
+    *   Adadelta: 1.000 to 0.001
+    *   Adagrad: 0.01 to 0.001
+    *   Adamax: 0.002 to 0.001
+    *   NAdam: 0.002 to 0.001
 
 ## Bug Fixes and Other Changes