Simple MultiProcess Inferencer build upon Pytorch. torchrun --nproc_per_node <num_of_process> cpu_env_template.py torchrun --nproc_per_node <num_of_gpu> gpu_env_template.py