Closed as not planned
Description
It will be perfect to have a wrapper function to turn the model into the vllm-enhanced model. (like PEFT).
It is useful if we have a lora model, we can "merge_and_unload" it with the base model, and then wrap it, or in the case that we need to pull from some specific model revision from HF.
Metadata
Metadata
Assignees
Labels
No labels