Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
BlueZeros authored May 19, 2024
1 parent 951eb3b commit 32f5412
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -122,22 +122,22 @@
2. 下载模型参数并运行(要求单卡显存 >= 15G)
* MING-MOE
```bash
CUDA_VISIBLE_DEVICES=0 python -m fastchat.serve.cli \
CUDA_VISIBLE_DEVICES=0 python ming/serve/cli.py \
--model_path {path_to_checkpoint} \ # 模型路径
--model_base {path_to_base_model} \ # 基座模型路径
--max-new-token 3072 # 输出最大长度
```

* MING-1.8B
```bash
CUDA_VISIBLE_DEVICES=0 python -m fastchat.serve.cli \
CUDA_VISIBLE_DEVICES=0 python ming/serve/cli.py \
--model_path {path_to_checkpoint} \ # 模型路径
--max-new-token 2048 # 输出最大长度
```

* MING-7B
```bash
CUDA_VISIBLE_DEVICES=0 python -m fastchat.serve.cli \
CUDA_VISIBLE_DEVICES=0 python ming/serve/cli.py \
--model_path {path_to_checkpoint} \ # 模型路径
--conv_template bloom \ # prompt
--max-new-token 512 \ # 输出最大长度
Expand Down

0 comments on commit 32f5412

Please sign in to comment.