Closed
Description
The model to consider.
internlm/internlm3-8b-instruct
Hope vllm will support internlm3-8b-instruct, thanks!
The closest model vllm already supports.
https://huggingface.co/internlm/internlm2_5-7b-chat
https://huggingface.co/internlm/internlm2_5-20b-chat
What's your difficulty of supporting the model you want?
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.