Skip to content

Commit aafaaf9

Browse files
author
xusenlin
committed
Fix typo
1 parent a6a7b11 commit aafaaf9

File tree

2 files changed

+1
-19
lines changed

2 files changed

+1
-19
lines changed

api/patches.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -165,4 +165,4 @@ def apply_rerope_patch(training_length: int = 4096, window_size: int = 512):
165165
global TRAINING_LENGTH, WINDOW_SIZE
166166
TRAINING_LENGTH, WINDOW_SIZE = training_length, window_size
167167
LlamaAttention.forward = forward_with_rerope
168-
logger.info(f"Apply NTK scaling with TRAINING_LENGTH={TRAINING_LENGTH}")
168+
logger.info(f"Apply ReRoPE with TRAINING_LENGTH={TRAINING_LENGTH}")

docs/SCRIPT.md

Lines changed: 0 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -325,24 +325,6 @@ docker run -it -d --gpus all --ipc=host --net=host -p 80:80 --name=aquila-chat-7
325325
--embedding_name moka-ai/m3e-base
326326
```
327327

328-
### NewHope
329-
330-
SLAM-group/NewHope:
331-
332-
```shell
333-
docker run -it -d --gpus all --ipc=host --net=host -p 80:80 --name=newhope \
334-
--ulimit memlock=-1 --ulimit stack=67108864 \
335-
-v `pwd`:/workspace \
336-
llm-api:pytorch \
337-
python api/app.py \
338-
--port 80 \
339-
--allow-credentials \
340-
--model_name newhope \
341-
--model_path SLAM-group/NewHope \
342-
--device cuda \
343-
--embedding_name moka-ai/m3e-base
344-
```
345-
346328
### Qwen-7b-chat
347329

348330
除已有的环境之外,推荐安装下面的依赖以提高运行效率和降低显存占用

0 commit comments

Comments
 (0)