Skip to content

Commit

Permalink
docs: Update instructions for use.
Browse files Browse the repository at this point in the history
  • Loading branch information
xixihahaliu committed Apr 10, 2024
1 parent ba35cec commit 1c8f4fd
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 20 deletions.
12 changes: 2 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,17 +61,9 @@ bash scripts/run_for_openai_api_with_gpu_in_Linux_or_WSL.sh
bash scripts/run_for_openai_api_in_M1_mac.sh
```

## Run With 4B LLM (Qwen1.5-4B-Chat-GGUF) On M1 Mac
<span style="color:red;">It is recommended to use the OpenAI API on Mac, because the performance of the QWen-4B/7B models is not good.</span>
## Run With 3B LLM (MiniChat-2-3B-INT8-GGUF) On M1 Mac
```bash
bash scripts/run_for_4B_in_M1_mac.sh
```

## Run With 7B LLM (Qwen1.5-7B-Chat-GGUF) On M1 Mac
<span style="color:red;">It is recommended to use the OpenAI API on Mac, because the performance of the QWen-4B/7B models is not good.</span>

```bash
bash scripts/run_for_7B_in_M1_mac.sh
bash scripts/run_for_3B_in_M1_mac.sh
```

## USE WITH WEB UI
Expand Down
12 changes: 2 additions & 10 deletions README_zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,18 +58,10 @@ bash scripts/run_for_openai_api_with_gpu_in_Linux_or_WSL.sh
bash scripts/run_for_openai_api_in_M1_mac.sh
```

## 在M1Mac环境下使用4BLLM(Qwen1.5-4B-Chat-GGUF)
<span style="color:red;">Mac上建议使用Openai API, Qwen 4B/7B模型效果不佳</span>
## 在M1Mac环境下使用3B LLM((MiniChat-2-3B-INT8-GGUF)

```bash
bash scripts/run_for_4B_in_M1_mac.sh
```

## 在M1Mac环境下使用7BLLM(Qwen1.5-7B-Chat-GGUF)
<span style="color:red;">Mac上建议使用Openai API, Qwen 4B/7B模型效果不佳</span>

```bash
bash scripts/run_for_7B_in_M1_mac.sh
bash scripts/run_for_3B_in_M1_mac.sh
```

## 访问前端页面
Expand Down

0 comments on commit 1c8f4fd

Please sign in to comment.