Skip to content

Commit

Permalink
Merge pull request #41 from remichu-ai/transformer_multimodal
Browse files Browse the repository at this point in the history
update README.md
  • Loading branch information
remichu-ai authored Nov 24, 2024
2 parents 1e5785e + 219eeac commit 28de07a
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,10 +44,9 @@ gallama run -id "model_id=pixtral max_seq_len=32768"
```

2. Qwen 2 VL:
As of this release, the transformers build in pip is not yet updated with bugfix for Qwen 2 VL, hence you will need to install the latest code from github.
This is already be handled in the requirements.txt, however, getting transformers dependency working can be tricky.
For Exllama V2, please install `dev` branch of Exllama V2 as the code is not yet merged to `v0.2.4`.

After installation you can download by following commands (choose a version that fit your VRAM):
After installation you can download by following commands (choose a version that fit your VRAM), there are other quantization available from 3 to 8bpw.
```shell
# 2B model
gallama download qwen-2-VL-2B:4.0
Expand Down

0 comments on commit 28de07a

Please sign in to comment.