Running inference on CPU

[Henrique-Potter]

How can we run superbench models' inference on CPU? It seems that it only supports GPU.

[abuccts]

PyTorch model inference should work on CPU. For TensorRT and ORT inference, they only work on NVIDIA GPU. The model inference benchmarks are mainly designed to validate GPUs rather to CPUs.