Turn on CMAKE_INTERPROCEDURAL_OPTIMIZATION in PR packages

[jackalcooper]

No description provided.

[github-actions]

Speed stats:

[github-actions]

CI failed when running job: cuda-speed-test. PR label automerge has been removed

[github-actions]

CI failed when running job: cuda-module. PR label automerge has been removed

[github-actions]

Speed stats:

GPU Name: NVIDIA GeForce GTX 1080 

❌ OneFlow resnet50 time: 129.6ms (= 12964.5ms / 100, input_shape=[16, 3, 224, 224])
PyTorch resnet50 time: 141.0ms (= 14100.9ms / 100, input_shape=[16, 3, 224, 224])
✔️ Relative speed: 1.09 (= 141.0ms / 129.6ms)

OneFlow resnet50 time: 76.5ms (= 7647.0ms / 100, input_shape=[8, 3, 224, 224])
PyTorch resnet50 time: 85.4ms (= 8541.5ms / 100, input_shape=[8, 3, 224, 224])
✔️ Relative speed: 1.12 (= 85.4ms / 76.5ms)

OneFlow resnet50 time: 53.1ms (= 10622.8ms / 200, input_shape=[4, 3, 224, 224])
PyTorch resnet50 time: 53.0ms (= 10594.4ms / 200, input_shape=[4, 3, 224, 224])
❌ Relative speed: 1.00 (= 53.0ms / 53.1ms)

OneFlow resnet50 time: 38.8ms (= 7753.7ms / 200, input_shape=[2, 3, 224, 224])
PyTorch resnet50 time: 42.8ms (= 8552.7ms / 200, input_shape=[2, 3, 224, 224])
✔️ Relative speed: 1.10 (= 42.8ms / 38.8ms)

OneFlow resnet50 time: 36.1ms (= 7220.8ms / 200, input_shape=[1, 3, 224, 224])
PyTorch resnet50 time: 44.2ms (= 8846.8ms / 200, input_shape=[1, 3, 224, 224])
✔️ Relative speed: 1.23 (= 44.2ms / 36.1ms)

OneFlow swin dataloader time: 0.239s (= 47.789s / 200, num_workers=1)
PyTorch swin dataloader time: 0.150s (= 29.925s / 200, num_workers=1)
Relative speed: 0.626 (= 0.150s / 0.239s)

OneFlow swin dataloader time: 0.065s (= 12.973s / 200, num_workers=4)
PyTorch swin dataloader time: 0.041s (= 8.285s / 200, num_workers=4)
Relative speed: 0.639 (= 0.041s / 0.065s)

OneFlow swin dataloader time: 0.036s (= 7.197s / 200, num_workers=8)
PyTorch swin dataloader time: 0.023s (= 4.591s / 200, num_workers=8)
Relative speed: 0.638 (= 0.023s / 0.036s)

❌ OneFlow resnet50 time: 145.5ms (= 14554.2ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 166.2ms (= 16622.7ms / 100, input_shape=[16, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.14 (= 166.2ms / 145.5ms)

OneFlow resnet50 time: 96.6ms (= 9662.8ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 112.1ms (= 11207.9ms / 100, input_shape=[8, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.16 (= 112.1ms / 96.6ms)

OneFlow resnet50 time: 72.9ms (= 14570.6ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 88.9ms (= 17785.7ms / 200, input_shape=[4, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.22 (= 88.9ms / 72.9ms)

OneFlow resnet50 time: 58.3ms (= 11656.6ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 74.2ms (= 14844.2ms / 200, input_shape=[2, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.27 (= 74.2ms / 58.3ms)

OneFlow resnet50 time: 55.2ms (= 11038.6ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
PyTorch resnet50 time: 71.2ms (= 14248.0ms / 200, input_shape=[1, 3, 224, 224], ddp, world size=2)
✔️ Relative speed: 1.29 (= 71.2ms / 55.2ms)