Skip to content

Commit

Permalink
Update colab_online.ipynb
Browse files Browse the repository at this point in the history
  • Loading branch information
Y1ran authored Jun 8, 2022
1 parent 92d21c1 commit 425147a
Showing 1 changed file with 19 additions and 19 deletions.
38 changes: 19 additions & 19 deletions colab_online.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -7,14 +7,14 @@
"[![GitHub stars](https://img.shields.io/github/stars/EssayKillerBrain/EssayKiller?style=social)](https://github.com/imcaspar/gpt2-ml)\n",
"[![GitHub](https://img.shields.io/github/license/EssayKillerBrain/EssayKiller)](https://github.com/imcaspar/gpt2-ml)\n",
"[![Twitter URL](https://img.shields.io/twitter/url?style=social&url=https%3A%2F%2Fgithub.com%2Fimcaspar%2Fgpt2-ml)](https://twitter.com/intent/tweet?text=Wow:&url=https://github.com/imcaspar/gpt2-ml)\n",
"### 四十二使用指南:\n",
"### 高考作文生成指南:\n",
"\n",
"* 点击代码框左上角的▶️",
"* 等待对应代码、模型文件下载\n",
"* 点击代码框左上角的▶️,选择RUN ANYWAY\n",
"* 等待对应代码文件、模型文件下载\n",
"* 输入参数,代表长度\n",
"* 输入问题,等待AI回答\n",
"* 输入作文题目(摘要模块没有部署,请自己提炼作文题中的主旨句)\n",
"\n",
"之后就会生成对应回答,效果如下:"
"之后就会生成对应文章,效果如下:"
]
},
{
Expand Down Expand Up @@ -52,9 +52,9 @@
"!mkdir -p /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models\n",
"\n",
"%cd /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/\n",
"!perl /home/EssayKiller_V2/LanguageNetwork/GPT2/scripts/gdown.pl https://drive.google.com/file/d/1A910UqSNBBi_SEoIDl15095T_5kojESO trained_models/model.ckpt-344000.data-00000-of-00001\n",
"!wget -q --show-progress https://github.com/EssayKillerBrain/EssayKiller/releases/download/v1.0/model.ckpt-344000.index -P /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models\n",
"!wget -q --show-progress https://github.com/EssayKillerBrain/EssayKiller/releases/download/v1.0/model.ckpt-344000.meta -P /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models\n",
"!perl /home/EssayKiller_V2/LanguageNetwork/GPT2/scripts/gdown.pl https://drive.google.com/file/d/1ajR-yVWmZC_z7HgNjz4tivNz-vUCgKBC trained_models/model.ckpt-280000.data-00000-of-00001\n",
"!wget -q --show-progress https://github.com/EssayKillerBrain/EssayKiller/releases/download/v1.0/model.ckpt-280000.index -P /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models\n",
"!wget -q --show-progress https://github.com/EssayKillerBrain/EssayKiller/releases/download/v1.0/model.ckpt-280000.meta -P /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models\n",
"\n",
"!echo '模型下载完成,Git项目已构建,请继续点击下方的▶️'\n",
"# If gdown.pl failed, please uncomment following code & exec"
Expand All @@ -66,13 +66,13 @@
"source": [
"### 模型参数设置:\n",
"\n",
"* 1.回答最小篇幅\n",
"生成对应字数的回答,可自己调节长度,最长为1024个汉字。\n",
"一般来说字数越短,AI表现越好\n",
"* 1.作文最小篇幅\n",
"生成对应字数的高考作文,可自己调节长度,最长为1024个汉字。\n",
"一般来说越短的文章AI表现越好\n",
"\n",
"* 2.生成回答篇数\n",
"默认会生成1篇回答,生成时间取决于服务器状态\n",
"受限于线上GPU内存,篇数最多为10\n"
"* 2.生成作文篇数\n",
"默认会生成1篇议论文,生成时间取决于服务器状态\n",
"一般不超过60秒。受限于线上GPU内存,篇数最多为100\n"
]
},
{
Expand All @@ -82,21 +82,21 @@
"outputs": [],
"source": [
"#!cat /usr/local/lib/python3.6/dist-packages/tensorflow_core/python/tpu/tpu_feed.py\n",
"#@title #回答生成模块\n",
"最小篇幅 = 1024 #@param {type:\"number\", min:800, max:1024, step:1}\n",
"生成篇数 = 1 #@param {type:\"number\", min:1, max:100, step:1}\n",
"#@title #文章生成模块\n",
"作文最小篇幅 = 1024 #@param {type:\"number\", min:800, max:1024, step:1}\n",
"生成作文篇数 = 1 #@param {type:\"number\", min:1, max:100, step:1}\n",
"%mv /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/models/mega/* /home/EssayKiller_V2/LanguageNetwork/GPT2/finetune/trained_models/\n",
"%cd /home/EssayKiller_V2/LanguageNetwork/GPT2/\n",
"!export TF_CPP_MIN_LOG_LEVEL=2\n",
"!echo '模型加载中,请稍后......'\n",
"!PYTHONPATH=$(pwd) python scripts/demo.py -ckpt_fn finetune/trained_models/model.ckpt-344000 -min_len $最小篇幅 -samples $生成篇数\n",
"!PYTHONPATH=$(pwd) python scripts/demo.py -ckpt_fn finetune/trained_models/model.ckpt-280000 -min_len $作文最小篇幅 -samples $生成作文篇数\n",
"!PYTHONPATH=$(pwd) python scripts/formatter.py -org_text result.txt"
]
}
],
"metadata": {
"colab": {
"name": "四十二生成式AI | Base on 1.7B GPT2 Pretrained Essay Killer Brain",
"name": "17亿参数-高考作文生成AI | 1.7B GPT2 Pretrained Essay Killer Brain",
"provenance": [],
"collapsed_sections": []
},
Expand Down

0 comments on commit 425147a

Please sign in to comment.