-
-
Notifications
You must be signed in to change notification settings - Fork 10.7k
Closed
Labels
new-modelRequests to new modelsRequests to new models
Description
The model to consider.
Collection: https://huggingface.co/collections/nvidia/nvlm-10-66e9f407c764a0ee6e37b7f4
NVLM-D 1.0 72B: https://huggingface.co/nvidia/NVLM-D-72B
The closest model vllm already supports.
https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/internvl.py
The Huggingface inference code was reportedly adapted from the InternVL codebase.
What's your difficulty of supporting the model you want?
NVLM 1.0 has a new architecture that may take some time to support in vLLM.
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Metadata
Metadata
Assignees
Labels
new-modelRequests to new modelsRequests to new models