Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

推理测试的代码 #4

Open
BestSongEver opened this issue Mar 17, 2023 · 2 comments
Open

推理测试的代码 #4

BestSongEver opened this issue Mar 17, 2023 · 2 comments

Comments

@BestSongEver
Copy link

BestSongEver commented Mar 17, 2023 •
edited
Loading

大佬您好，请问您可以更新一下对fine-tune后模型的推理测试的代码吗？
另外，训练是否有一些策略呢，比如提升speed
谢谢！
多么令人敬爱的大佬！@ssbuild
@ssbuild
Copy link
Owner

ssbuild commented Mar 19, 2023

@BestSongEver

已添加推理demo ， 策略的多卡数据并行足够了，短平快。

@BestSongEver
Copy link
Author

BestSongEver commented Mar 23, 2023 •
edited
Loading

谢谢您的回复！
关于infer等，有个问题想听您的观点:
为啥大家都在关注chatglm的微调、推理。关注这个项目的缺很少？对于某特定领域数据的微调和落地应用，这个小模型不够用吗？并且它小，不是更方便产品化应用？@ssbuild

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@BestSongEver @ssbuild