-
Notifications
You must be signed in to change notification settings - Fork 218
[Hackathon 5th No.75] 新增模型InstructBlip #353
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Thanks for your contribution! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
1.将config 相关的yam文件,改成跟其他模型一样的config.json,可通过from_pretrained下载。
2.是否与pytorch对齐,在pr页面给一下对齐结果,或日志;
3.提供一下推理训练(如有)脚本,还有README.md,参考paddlemix/examples/blip2
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这个脚本与现有的base_processing.py有点重叠,且该定义在blip2_instruct_processing.py定义了,去掉该脚本
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
该脚本的类名都带上blip2_instruct相关的字段,与现有的blip2做区分
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
该脚本单独写到examples下,并配上相关readme.md说明文档
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
该脚本与现有的base_model.py重叠,包括,要么修改成blip2_instruct_base_model.py,要么放到base_model.py里面
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
该 脚本与blip2_opt2_instruct.py有什么区别或联系,能否合成一个脚本
LGTM + 对齐结果 |
No description provided.