eager global nozero

[liufengwei0103]

No description provided.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Code got formatted by CI. Please request CI again if you still want to have this PR merged. If the PR is from a forked repo, please download the patch files from the GitHub Actions web page and apply them locally.

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

✔️ OneFlow resnet50 time: 128.6ms (= 12855.3ms / 100, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 138.7ms (= 13874.3ms / 100, input_shape=[16, 3, 224, 224])
✔️ Relative speed: 1.08 (= 138.7ms / 128.6ms)

✔️ OneFlow resnet50 time: 77.3ms (= 7730.5ms / 100, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 86.2ms (= 8618.0ms / 100, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.11 (= 86.2ms / 77.3ms)

OneFlow resnet50 time: 53.3ms (= 10657.0ms / 200, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 59.8ms (= 11965.6ms / 200, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.12 (= 59.8ms / 53.3ms)

OneFlow resnet50 time: 44.4ms (= 8870.5ms / 200, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 50.6ms (= 10123.2ms / 200, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.14 (= 50.6ms / 44.4ms)

OneFlow resnet50 time: 36.3ms (= 7253.7ms / 200, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 37.6ms (= 7515.2ms / 200, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 1.04 (= 37.6ms / 36.3ms)

✔️ OneFlow resnet50 time: 141.9ms (= 14188.2ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 160.6ms (= 16062.9ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.13 (= 160.6ms / 141.9ms)
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

OneFlow resnet50 time: 89.8ms (= 8984.8ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 103.4ms (= 10339.9ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.15 (= 103.4ms / 89.8ms)
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

OneFlow resnet50 time: 62.6ms (= 12518.5ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 76.1ms (= 15217.3ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.22 (= 76.1ms / 62.6ms)
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

OneFlow resnet50 time: 51.9ms (= 10385.1ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 67.7ms (= 13547.6ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.30 (= 67.7ms / 51.9ms)
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

OneFlow resnet50 time: 47.6ms (= 9511.6ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 61.7ms (= 12331.2ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.30 (= 61.7ms / 47.6ms)
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************