Eager global mul

[liufengwei0103]

No description provided.

[github-actions]

Speed stats:

GPU Name: GeForce GTX 1080 

✔️ OneFlow resnet50 time: 128.2ms (= 12822.4ms / 100, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 140.5ms (= 14054.6ms / 100, input_shape=[16, 3, 224, 224])
✔️ Relative speed: 1.10 (= 140.5ms / 128.2ms)

✔️ OneFlow resnet50 time: 76.6ms (= 7662.0ms / 100, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 81.4ms (= 8138.8ms / 100, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.06 (= 81.4ms / 76.6ms)

OneFlow resnet50 time: 51.9ms (= 10371.4ms / 200, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 54.5ms (= 10906.8ms / 200, input_shape=[4, 3, 224, 224])
✔️ Relative speed: 1.05 (= 54.5ms / 51.9ms)

OneFlow resnet50 time: 42.5ms (= 8493.0ms / 200, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 48.8ms (= 9764.2ms / 200, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.15 (= 48.8ms / 42.5ms)

OneFlow resnet50 time: 39.0ms (= 7795.4ms / 200, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 39.0ms (= 7792.3ms / 200, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 1.00 (= 39.0ms / 39.0ms)

OneFlow swin dataloader time: 0.246s (= 49.286s / 200, num_workers=1)
PyTorch swin dataloader time: 0.249s (= 49.890s / 200, num_workers=1)
✔️ Relative speed: 1.012 (= 0.249s / 0.246s)

OneFlow swin dataloader time: 0.068s (= 13.595s / 200, num_workers=4)
PyTorch swin dataloader time: 0.069s (= 13.841s / 200, num_workers=4)
✔️ Relative speed: 1.018 (= 0.069s / 0.068s)

OneFlow swin dataloader time: 0.037s (= 7.353s / 200, num_workers=8)
PyTorch swin dataloader time: 0.038s (= 7.568s / 200, num_workers=8)
✔️ Relative speed: 1.029 (= 0.038s / 0.037s)

✔️ OneFlow resnet50 time: 135.6ms (= 13562.0ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 158.5ms (= 15850.9ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.17 (= 158.5ms / 135.6ms)

OneFlow resnet50 time: 88.6ms (= 8862.9ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 101.3ms (= 10134.7ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.14 (= 101.3ms / 88.6ms)

OneFlow resnet50 time: 62.6ms (= 12514.7ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 75.9ms (= 15189.3ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.21 (= 75.9ms / 62.6ms)

OneFlow resnet50 time: 53.5ms (= 10699.7ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 71.8ms (= 14367.3ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.34 (= 71.8ms / 53.5ms)

OneFlow resnet50 time: 49.4ms (= 9872.6ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 62.1ms (= 12410.9ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.26 (= 62.1ms / 49.4ms)