Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[VLM][Model] Support image input for Chameleon #6633

Merged
merged 14 commits into from
Jul 23, 2024
Merged

[VLM][Model] Support image input for Chameleon #6633

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
555d56f
iterate
ywang96 Jul 22, 2024
ea1097f
add to doc
ywang96 Jul 22, 2024
b539cd4
fix loading and type hint
ywang96 Jul 22, 2024
92b6316
add sep token
ywang96 Jul 22, 2024
edb72aa
patch chat util
ywang96 Jul 22, 2024
f7ec6ee
patch model class
ywang96 Jul 22, 2024
fa63f90
patch get max tokens
ywang96 Jul 22, 2024
763e1f0
address comments
ywang96 Jul 23, 2024
1e61707
add chameleon to entrypoint test
ywang96 Jul 23, 2024
6d9135b
revert
ywang96 Jul 23, 2024
fe67c84
add test
ywang96 Jul 23, 2024
a919ca7
format
ywang96 Jul 23, 2024
ebb8f9e
docstring and TODO
ywang96 Jul 23, 2024
bec0abd
add correct architecture for futureproof
ywang96 Jul 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
add correct architecture for futureproof
  • Loading branch information
@ywang96
ywang96 committed Jul 23, 2024
commit bec0abdd7b8d7d357a1e0b726b90dab9603a899f
7 changes: 4 additions & 3 deletions vllm/model_executor/models/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,10 @@
"BaiChuanForCausalLM": ("baichuan", "BaiChuanForCausalLM"), # baichuan-7b
"BaichuanForCausalLM": ("baichuan", "BaichuanForCausalLM"), # baichuan-13b
"BloomForCausalLM": ("bloom", "BloomForCausalLM"),
"ChameleonForCausalLM":
("chameleon", "ChameleonForConditionalGeneration"
), #TODO(ywang96): fix model name when huggingface fixes it
#TODO(ywang96): remove this when huggingface fixes the model repo
"ChameleonForCausalLM": ("chameleon", "ChameleonForConditionalGeneration"),
"ChameleonForConditionalGeneration":
("chameleon", "ChameleonForConditionalGeneration"),
"ChatGLMModel": ("chatglm", "ChatGLMForCausalLM"),
"ChatGLMForConditionalGeneration": ("chatglm", "ChatGLMForCausalLM"),
"CohereForCausalLM": ("commandr", "CohereForCausalLM"),
Expand Down
Loading