Skip to content

[Hackathon 5th No.75] 新增模型InstructBlip #353

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

essos-bot
Copy link
Contributor

No description provided.

Copy link

paddle-bot bot commented Dec 15, 2023

Thanks for your contribution!

Copy link
Collaborator

@LokeZhou LokeZhou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1.将config 相关的yam文件,改成跟其他模型一样的config.json,可通过from_pretrained下载。
2.是否与pytorch对齐,在pr页面给一下对齐结果,或日志;
3.提供一下推理训练(如有)脚本,还有README.md,参考paddlemix/examples/blip2

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个脚本与现有的base_processing.py有点重叠,且该定义在blip2_instruct_processing.py定义了,去掉该脚本

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

该脚本的类名都带上blip2_instruct相关的字段,与现有的blip2做区分

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

该脚本单独写到examples下,并配上相关readme.md说明文档

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

该脚本与现有的base_model.py重叠,包括,要么修改成blip2_instruct_base_model.py,要么放到base_model.py里面

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

该 脚本与blip2_opt2_instruct.py有什么区别或联系,能否合成一个脚本

@LokeZhou
Copy link
Collaborator

LGTM + 对齐结果

@luotao1 luotao1 added the PaddlePaddle Hackathon 飞桨黑客松活动issue与PR label Jan 15, 2024
@LokeZhou LokeZhou closed this Feb 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributor PaddlePaddle Hackathon 飞桨黑客松活动issue与PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants