TensorFlow version of L_SoftMax.
I found prelu
is quite stable than relu
, so I used prelu
as paper said.
This is mainly implemented by py_func
, which is quite slow. If anyone have implemented a tf_op
in C++ or cuda, pull request is warmly welcome.