In the early experiments, I found `rmsprop` to work better as an optimizer. At some point I changed it to Adam. I should turn it back to `rmsprop`.
