new api of elu gelu relu logsigmoid, test=develop #2407

qili93 · 2020-08-17T13:31:33Z

新增/修改如下2.0 API:

ELU:

paddle.nn.ELU(alpha=1.0, name=None) - 新增此class
paddle.nn.functional.elu(x, alpha=1.0, name=None) - 新增此function

GELU

paddle.nn.GELU(alpha=1.0, name=None) - 新增此class
paddle.nn.functional.gelu(x, approximate=False, name=None) - 新增此function，参数approximate保留

ReLU

paddle.nn.ReLU(name=None) - 保持，删除alias, 删除inplace, input改为x，
paddle.nn.functional.relu(x, alpha=1.0, name=None) - 删除inplace，input改为x，完善文档改用动态图demo

LogSigmoid

paddle.nn.LogSigmoid(name=None) - 新增此class
paddle.nn.functional.logsigmoid(x, name=None) - 新增此function

doc/fluid/api_cn/nn_cn/elu_cn.rst

…to new_20_api

zhupengyang

LGTM

zhupengyang · 2020-08-19T06:35:07Z

doc/fluid/api_cn/nn_cn/activation_cn/ELU_cn.rst

+  
+    paddle.disable_static()
+
+    x = paddle.to_tensor(np.array([[-1,6],[1,15.6]]))


逗号后面加个空格？

TCChenlong · 2020-08-19T06:52:08Z

doc/fluid/api_cn/nn_cn/relu_cn.rst

+
+代码示例
+::::::::::
+


少了这一行：【.. code-block:: python】

TCChenlong · 2020-08-19T06:53:12Z

doc/fluid/api_cn/nn_cn/gelu_cn.rst

+参数:
+::::::::::
+ - x (Tensor) - 输入的 ``Tensor`` ，数据类型为：float32、float64。
+ - approximate (bool, 可选) - 是否使用近似计算，默认值为 False。


这里最好明确下False的行为，如：
【- approximate (bool, 可选) - 是否使用近似计算，默认值为 False，表示不使用近似计算。】

TCChenlong · 2020-08-19T06:59:33Z

doc/fluid/api_cn/nn_cn/activation_cn/ELU_cn.rst

+
+ELU激活层（ELU Activation Operator）
+
+根据 https://arxiv.org/abs/1511.07289 对输入Tensor中每个元素应用以下计算。


这里直接放链接不太好，建议改成和GELU一样的格式，可以参考：
【根据 Exponential Linear Units <https://arxiv.org/abs/1511.07289> 对输入Tensor中每个元素应用以下计算。】

TCChenlong · 2020-08-19T07:01:13Z

doc/fluid/api_cn/nn_cn/activation_cn/ReLU_cn.rst

@@ -0,0 +1,36 @@
+.. _cn_api_nn_ReLU:
+
+ELU


这里应该是【ReLU】；

TCChenlong · 2020-08-19T07:07:46Z

doc/fluid/api_cn/nn_cn/activation_cn/ELU_cn.rst

+
+ELU
+-------------------------------
+.. py:class:: paddle.nn.ELU(x, alpha=1.0, name=None)


【ELU】的参数里没有【x】

TCChenlong · 2020-08-19T07:11:32Z

doc/fluid/api_cn/nn_cn/activation_cn/GELU_cn.rst

@@ -0,0 +1,54 @@
+.. _cn_api_fluid_layers_gelu:


这个地方，应该是【_cn_api_nn_GELU】

TCChenlong · 2020-08-19T07:12:33Z

doc/fluid/api_cn/nn_cn/activation_cn/GELU_cn.rst

+
+参数
+::::::::::
+    - approximate (bool, 可选) - 是否使用近似计算，默认值为 False。


这里最好描述下False的行为，可以参考：
【 - approximate (bool, 可选) - 是否使用近似计算，默认值为 False，即不使用近似计算。】

TCChenlong · 2020-08-19T07:14:10Z

doc/fluid/api_cn/nn_cn/activation_cn/GELU_cn.rst

+
+    paddle.disable_static()
+    data = np.random.randn(2, 3).astype("float32")
+    x = paddle.to_tensor(data)


这里可否换为非随机的输入？随机的输入最后的输出无法具有参考性~

TCChenlong · 2020-08-19T07:14:40Z

doc/fluid/api_cn/nn_cn/activation_cn/LogSigmoid_cn.rst

+LogSigmoid
+-------------------------------
+.. py:class:: paddle.nn.LogSigmoid(x, name=None)
+


这里也没有【x】

TCChenlong · 2020-08-19T07:15:07Z

doc/fluid/api_cn/nn_cn/activation_cn/ReLU_cn.rst

+ELU
+-------------------------------
+.. py:class:: paddle.nn.ReLU(x, name=None)
+


这里也没有【x】

TCChenlong · 2020-08-19T08:12:43Z

doc/fluid/api_cn/nn_cn/elu_cn.rst

+elu激活层（ELU Activation Operator）
+
+根据 https://arxiv.org/abs/1511.07289 对输入Tensor中每个元素应用以下计算。
+


根据 Exponential Linear Units <https://arxiv.org/abs/1511.07289> 对输入Tensor中每个元素应用以下计算。

TCChenlong

LGTM~

qili93 · 2020-08-20T11:17:14Z

ELU English Doc

qili93 · 2020-08-20T11:17:41Z

GELU English Doc

qili93 · 2020-08-20T11:18:07Z

RELU English Doc

qili93 · 2020-08-20T11:18:36Z

LogSigmoid English Doc

new api of elu gelu relu logsigmoid, test=develop

47ef48e

zhupengyang reviewed Aug 19, 2020

View reviewed changes

doc/fluid/api_cn/nn_cn/elu_cn.rst Outdated Show resolved Hide resolved

qili93 added 3 commits August 19, 2020 04:22

Merge branch 'develop' of https://github.com/PaddlePaddle/FluidDoc in…

a568dc5

…to new_20_api

address review comments, test=develop

9d39f0d

fix temp error, test=develop

8954995

zhupengyang approved these changes Aug 19, 2020

View reviewed changes

zhupengyang reviewed Aug 19, 2020

View reviewed changes

address review comments, test=develop

8ff14da

TCChenlong reviewed Aug 19, 2020

View reviewed changes

address review comments, test=develop

71a3978

TCChenlong reviewed Aug 19, 2020

View reviewed changes

qili93 added 2 commits August 19, 2020 08:15

address review comments, test=develop

2bb37aa

address review comments, test=develop

fd5c057

TCChenlong approved these changes Aug 19, 2020

View reviewed changes

zhupengyang merged commit de8a21a into PaddlePaddle:develop Aug 19, 2020

qili93 deleted the new_20_api branch August 19, 2020 09:37

qili93 mentioned this pull request Aug 21, 2020

elu gelu relu logsigmoid, test=develop PaddlePaddle/Paddle#26304

Merged


		paddle.disable_static()

		x = paddle.to_tensor(np.array([[-1,6],[1,15.6]]))


		ELU激活层（ELU Activation Operator）

		根据 https://arxiv.org/abs/1511.07289 对输入Tensor中每个元素应用以下计算。


		代码示例
		::::::::::

new api of elu gelu relu logsigmoid, test=develop #2407

new api of elu gelu relu logsigmoid, test=develop #2407

Uh oh!

Conversation

qili93 commented Aug 17, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

zhupengyang left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

TCChenlong left a comment

Choose a reason for hiding this comment

Uh oh!

qili93 commented Aug 20, 2020

Uh oh!

qili93 commented Aug 20, 2020

Uh oh!

qili93 commented Aug 20, 2020

Uh oh!

qili93 commented Aug 20, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

qili93 commented Aug 17, 2020 •

edited

Loading