Skip to content

Commit fc7d940

Browse files
committed
update readme
1 parent 7b5c6c5 commit fc7d940

8 files changed

+24
-0
lines changed

.DS_Store

0 Bytes
Binary file not shown.

README.md

+12
Original file line numberDiff line numberDiff line change
@@ -433,6 +433,16 @@ d. 清洗类-特殊逻辑规则:此类规则用于清洗一些特殊现象数
433433

434434
## 测评
435435

436+
V2版SFT和base模型测评结果
437+
438+
![image](image/evaluation_sft_v2.jpg)
439+
440+
![image](image/evaluation_base_v2.jpg)
441+
442+
<details>
443+
444+
V1版SFT和base模型测评结果
445+
436446
在 7 项英文 NLP 任务上,对 SFT 模型进行测评,以 OpenAI-InstructGPT-6B-SFT 为基准,归一化并平均各模型的得分,结果如下:
437447

438448
![image](image/auto-valuation-1.png)
@@ -441,6 +451,8 @@ d. 清洗类-特殊逻辑规则:此类规则用于清洗一些特殊现象数
441451

442452
![image](image/auto-valuation-2.png)
443453

454+
</details>
455+
444456
## API
445457

446458
TigerBot 提供了三种 API,包括 Chat-API,Plug-ins,Fine-Tunes。

README_en.md

+12
Original file line numberDiff line numberDiff line change
@@ -338,6 +338,16 @@ We clean and filter data as follows:
338338
| [Wiki](https://huggingface.co/datasets/TigerResearch/tigerbot-wiki-plugin) | 100K |
339339

340340
## Evaluation
341+
342+
Evaluation result of V2 version SFT and and base model
343+
344+
![image](image/evaluation_sft_v2.jpg)
345+
346+
![image](image/evaluation_base_v2.jpg)
347+
348+
<details>
349+
Evaluation result of V1 version SFT and and base model
350+
341351
We evaluate our SFT models on seven public NLP datasets, and compare these with OpenAI-InstructGPT.
342352
Results against OpenAI-InstructGPT-6B-SFT.
343353

@@ -348,6 +358,8 @@ Results against bloom-7b1.
348358

349359
![image](image/auto-valuation-2.png)
350360

361+
</details>
362+
351363
## API
352364

353365
TigerBot provide APIs including Chat-API,Plug-ins,Fine-Tunes.

gptq/.DS_Store

0 Bytes
Binary file not shown.

image/.DS_Store

0 Bytes
Binary file not shown.

image/api/.DS_Store

0 Bytes
Binary file not shown.

image/evaluation_base_v2.jpg

82.8 KB
Loading

image/evaluation_sft_v2.jpg

59.2 KB
Loading

0 commit comments

Comments
 (0)