Skip to content

Commit

Permalink
Update README.md (#357)
Browse files Browse the repository at this point in the history
* Update README.md

* Update README.md
  • Loading branch information
upvenly authored Dec 7, 2023
1 parent 1edbda2 commit d954729
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions training/benchmarks/aquila2_7b/flagscale/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,9 @@ aquila2是北京人工智能研究院开源的语言模型,包含基础语言

## 模型配置及tokenizer准备

本测试样例为预训练case,需要下载tokenizer,下载链接为https://github.com/FlagOpen/FlagScale/tree/main/examples/aquila/tokenizer。需要在data_dir下创建tokenizer目录,将上述链接中的三个文件下载到此目录中
本测试样例为预训练case,需要下载tokenizer,下载链接为https://github.com/FlagOpen/FlagScale/tree/main/examples/aquila/tokenizer

此tokenizer需要下载FlagScale仓库ed55532这一commit版本,需要在data_dir下创建tokenizer目录,将上述链接中的三个文件下载到此目录中

## 数据准备

Expand All @@ -14,4 +16,4 @@ https://model.ks3-cn-beijing.ksyuncs.com/nlpdata/pile_wikipedia_demo.bin

https://model.ks3-cn-beijing.ksyuncs.com/nlpdata/pile_wikipedia_demo.idx

将上述两个文件放置于data_dir下。
将上述两个文件放置于data_dir下。

0 comments on commit d954729

Please sign in to comment.