Skip to content

Commit e665744

Browse files
authored
llava : fix the script error in MobileVLM README (#9054)
Signed-off-by: Erhu Feng <2748250768@qq.com>
1 parent d4c3c10 commit e665744

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

examples/llava/MobileVLM-README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -39,15 +39,15 @@ python ./examples/llava/llava_surgery.py -m path/to/MobileVLM-1.7B
3939
3. Use `convert_image_encoder_to_gguf.py` with `--projector-type ldp` (for **V2** please use `--projector-type ldpv2`) to convert the LLaVA image encoder to GGUF:
4040

4141
```sh
42-
python ./examples/llava/convert_image_encoder_to_gguf \
42+
python ./examples/llava/convert_image_encoder_to_gguf.py \
4343
-m path/to/clip-vit-large-patch14-336 \
4444
--llava-projector path/to/MobileVLM-1.7B/llava.projector \
4545
--output-dir path/to/MobileVLM-1.7B \
4646
--projector-type ldp
4747
```
4848

4949
```sh
50-
python ./examples/llava/convert_image_encoder_to_gguf \
50+
python ./examples/llava/convert_image_encoder_to_gguf.py \
5151
-m path/to/clip-vit-large-patch14-336 \
5252
--llava-projector path/to/MobileVLM-1.7B_V2/llava.projector \
5353
--output-dir path/to/MobileVLM-1.7B_V2 \
@@ -57,12 +57,12 @@ python ./examples/llava/convert_image_encoder_to_gguf \
5757
4. Use `examples/convert_legacy_llama.py` to convert the LLaMA part of LLaVA to GGUF:
5858

5959
```sh
60-
python ./examples/convert_legacy_llama.py path/to/MobileVLM-1.7B
60+
python ./examples/convert_legacy_llama.py path/to/MobileVLM-1.7B --skip-unknown
6161
```
6262

63-
5. Use `quantize` to convert LLaMA part's DataType from `fp16` to `q4_k`
63+
5. Use `quantize` to convert LLaMA part's DataType from `fp32` to `q4_k`
6464
```sh
65-
./llama-quantize path/to/MobileVLM-1.7B/ggml-model-f16.gguf path/to/MobileVLM-1.7B/ggml-model-q4_k.gguf q4_k_s
65+
./llama-quantize path/to/MobileVLM-1.7B/ggml-model-F32.gguf path/to/MobileVLM-1.7B/ggml-model-q4_k.gguf q4_k_s
6666
```
6767

6868
Now both the LLaMA part and the image encoder is in the `MobileVLM-1.7B` directory.

0 commit comments

Comments
 (0)