Closed
Description
https://github.com/vllm-project/vllm/releases
- incorporate --num-scheduler-steps 8
- test openai tool spec
- test multi multi modal input support
- test tensor parallel for ViT models in multi modal llms
- supported tensor-parallel ViT models. [(also test the new xformers ]([VLM][Model] TP support for ViTs vllm-project/vllm#7186)
- Siglip
- Clip
- Blip
- Intern ViT
Metadata
Assignees
Labels
No labels