-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add RoFormer Model #804
add RoFormer Model #804
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please also add an example of RoFormer to paddlenlp's examples. eg.
https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/roformer
And also please provide more pretrained weight sent to @yingyibiao, we will help you upload the pretrained weight of RoFromer.
@yingyibiao |
done |
please install pre-commit to format code style e.g.: pip install pre-commit & pre-commit install |
@yingyibiao |
可以对每个文件做一些格式上的小修改,然后重新提交~ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
converter这个目录可以删除,这个是遗留的老代码
@yingyibiao |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
建议增加一个论文上的CAIL2019-SCM任务的example
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great job!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
PR types
PR changes
Description
添加RoFormer模型