Support linux for vllm cpu local development

[nurali-techie]

🚀 Enhancement Description and Motivation

As we know, vllm cpu setup is very useful for local development. Currently, Mac setup steps are provided. We propose to add steps for Linux which will help the dev community using Linux on their machines.

Use Case

Developer with a Linux machine wants to setup vllm cpu for local development.

Proposed Solution

First create and push vllm docker image on linux using vllm-project/vllm/Dockerfile.arm

docker build -f Dockerfile.arm -t aibrix/vllm-cpu-env:linux-amd64 --shm-size=4g .

Next, use the Linux image aibrix/vllm-cpu-env:linux-amd64 instead of the Mac image aibrix/vllm-cpu-env:macos while setting up vllm cpu for local development.

[Jeffwan]

This would be super helpful! Thanks for bringing up this proposal.