DeepSeekCoderV2 #5763
Description
The model to consider.
https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct
The closest model vllm already supports.
DeepSeek MoE
What's your difficulty of supporting the model you want?
Inexperienced in porting to vLLM