Skip to content

【开源实习】bert_generation模型微调 #1911

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Feb 27, 2025

Conversation

guyueyuan
Copy link
Contributor

@guyueyuan guyueyuan commented Jan 17, 2025

1.实现了bert_generation模型结合clip模型,在coco2017数据集上的ZOC任务全参微调,任务链接:https://gitee.com/mindspore/community/issues/IAUP32
由于原baseline中没有loss的说明,这里通过精度评估的参数来对比

2.pytorch任务结果对比:
image
以上图片是baseline仓库中的原论文中的图片

3.在mindnlp微调后结果:
cifar10:
image
cifar100:
image
tin'yimagenet:
image

可见,mindnlp微调后,模型与任务水准持平或略高于pytorch结果

@lvyufeng lvyufeng merged commit 9149ebc into mindspore-lab:master Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants