inference tools like vllm can support?

[zhang001122]

as i mentioned , deepseek-moe is supported by vllm now ?

[Xingxiangrui]

+1 for this

[luofuli]

We will soon support vllm inference

[zwd003]

we have add a support for vllm here vllm-project/vllm#2453