Skip to content

Commit 6628220

Browse files
committed
moidfy eval
1 parent 6c35e85 commit 6628220

File tree

4 files changed

+6
-2
lines changed

4 files changed

+6
-2
lines changed

README.md

+6-2
Original file line numberDiff line numberDiff line change
@@ -307,9 +307,13 @@ CUDA_VISIBLE_DEVICES=0,1 python tigerbot_infer.py ${MODEL_DIR} --wbits 4 --group
307307

308308
## 测评
309309

310-
在 7 项 NLP 任务上进行模型测评,以 OpenAI-InstructGPT-6B-SFT 为基准,归一化并平均各模型的得分,结果如下:
310+
在7项英文NLP任务上,对SFT模型进行测评,以 OpenAI-InstructGPT-6B-SFT 为基准,归一化并平均各模型的得分,结果如下:
311311

312-
![image](image/auto-valuation.png)
312+
![image](image/auto-valuation-1.png)
313+
314+
在7项英文NLP任务和4项中文NLP任务上,对Pretrain模型进行测评,以 bloom-7b1 为基准,归一化并平均各模型的得分,结果如下:
315+
316+
![image](image/auto-valuation-2.png)
313317

314318
## API
315319

image/auto-valuation-1.png

74.7 KB
Loading

image/auto-valuation-2.png

91.9 KB
Loading

image/auto-valuation.png

-79.4 KB
Binary file not shown.

0 commit comments

Comments
 (0)