Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ERNIE-M] Add ernie-m #1510

Merged
merged 19 commits into from
Dec 30, 2021
Merged

[ERNIE-M] Add ernie-m #1510

merged 19 commits into from
Dec 30, 2021

Conversation

gongel
Copy link
Member

@gongel gongel commented Dec 23, 2021 •
edited
Loading

PR types

New features

PR changes

Models

Description

  • Add ernie-m model
  • Add natural language inference task

guoshengCS
guoshengCS reviewed Dec 24, 2021
View reviewed changes
Copy link
Contributor

@guoshengCS guoshengCS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

README是否也注意补上

paddlenlp/transformers/ernie_m/modeling.py Show resolved Hide resolved
paddlenlp/transformers/ernie_m/tokenizer.py Outdated Show resolved Hide resolved
paddlenlp/transformers/ernie_m/tokenizer.py Outdated Show resolved Hide resolved
examples/language_model/ernie-m/run_classifier.py Outdated Show resolved Hide resolved
examples/language_model/ernie-m/run_classifier.py Outdated
paddle.distributed.init_parallel_env()

set_seed(args)
tokenizer = ErnieMTokenizer.from_pretrained(args.model_name_or_path)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

咱们后续是否要统一AutoModel和AutoTokenizer的使用，还请 @ZeyuChen 判断下

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

统一吧，这样后续新增模型的时候，大家需要有一个往Auto里面注册的机制。@gongel

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Both are done. Thx.

@gongel gongel mentioned this pull request Dec 24, 2021
Closed
ZeyuChen
ZeyuChen reviewed Dec 25, 2021
View reviewed changes
examples/language_model/ernie-m/README.md Outdated Show resolved Hide resolved
examples/language_model/ernie-m/run_classifier.py Outdated
paddle.distributed.init_parallel_env()

set_seed(args)
tokenizer = ErnieMTokenizer.from_pretrained(args.model_name_or_path)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

统一吧，这样后续新增模型的时候，大家需要有一个往Auto里面注册的机制。@gongel

examples/language_model/ernie-m/README.md Show resolved Hide resolved
@ZeyuChen ZeyuChen self-assigned this Dec 25, 2021
@ZeyuChen ZeyuChen added the enhancement New feature or request label Dec 25, 2021
@gongel gongel merged commit 7c8dd35 into PaddlePaddle:develop Dec 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@guoshengCS guoshengCS guoshengCS left review comments

@ZeyuChen ZeyuChen ZeyuChen approved these changes

@tianxin1860 tianxin1860 Awaiting requested review from tianxin1860

Assignees

@ZeyuChen ZeyuChen

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@gongel @ZeyuChen @guoshengCS