add abs, activation and 0 dim tensor tests

[hjchen2]

No description provided.

[github-actions]

CI failed when running job: cuda-module-distributed-rank-1. PR label automerge has been removed

[github-actions]

CI failed when running job: cuda-module-distributed-rank-0. PR label automerge has been removed

[github-actions]

Speed stats:

[github-actions]

CI failed when running job: cuda-module. PR label automerge has been removed

[github-actions]

Speed stats:

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

✔️ OneFlow resnet50 time: 128.5ms (= 12845.8ms / 100, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 141.0ms (= 14100.3ms / 100, input_shape=[16, 3, 224, 224])
✔️ Relative speed: 1.10 (= 141.0ms / 128.5ms)

✔️ OneFlow resnet50 time: 77.8ms (= 7777.2ms / 100, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 84.8ms (= 8485.0ms / 100, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.09 (= 84.8ms / 77.8ms)

OneFlow resnet50 time: 52.4ms (= 10484.0ms / 200, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 57.9ms (= 11575.5ms / 200, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.10 (= 57.9ms / 52.4ms)

OneFlow resnet50 time: 40.7ms (= 8133.9ms / 200, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 46.2ms (= 9247.6ms / 200, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.14 (= 46.2ms / 40.7ms)

OneFlow resnet50 time: 36.2ms (= 7242.0ms / 200, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 39.7ms (= 7940.1ms / 200, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 1.10 (= 39.7ms / 36.2ms)

✔️ OneFlow resnet50 time: 142.3ms (= 14227.2ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 162.3ms (= 16230.6ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.14 (= 162.3ms / 142.3ms)

OneFlow resnet50 time: 89.5ms (= 8951.2ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 103.3ms (= 10327.5ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.15 (= 103.3ms / 89.5ms)

OneFlow resnet50 time: 62.2ms (= 12441.1ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 73.5ms (= 14691.8ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.18 (= 73.5ms / 62.2ms)

OneFlow resnet50 time: 54.0ms (= 10796.6ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 66.1ms (= 13215.5ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.22 (= 66.1ms / 54.0ms)

OneFlow resnet50 time: 50.0ms (= 9992.5ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 59.4ms (= 11872.1ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.19 (= 59.4ms / 50.0ms)