Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: ernie预训练报错 #6723

Open
1 task done
ZTurboX opened this issue Aug 15, 2023 · 1 comment
Open
1 task done

[Bug]: ernie预训练报错 #6723

ZTurboX opened this issue Aug 15, 2023 · 1 comment
Assignees
Labels
bug Something isn't working triage

Comments

@ZTurboX
Copy link

ZTurboX commented Aug 15, 2023

软件环境

- paddlepaddle:2.5.1
- paddlepaddle-gpu: 2.5.1
- paddlenlp: develop

重复问题

  • I have searched the existing issues

错误描述

用最新的paddlenlp develop增量预训练ernie-3.0-tiny-micro-v2-zh会报错TypeError: init() got an unexpected keyword argument 'enable_recompute'

稳定复现步骤 & 代码

训练脚本
python -u -m paddle.distributed.launch
--gpus "0,1"
--log_dir "output/ernie-3.0-tiny-micro-v2-zh/log"
run_pretrain.py
--model_type "ernie"
--model_name_or_path "./ernie-3.0-tiny-micro-v2-zh"
--tokenizer_name_or_path "./ernie-3.0-tiny-micro-v2-zh"
--input_dir "./train_data"
--output_dir "output/ernie-3.0-tiny-micro-v2-zh"
--split 949,50,1
--max_seq_len 512
--micro_batch_size 16
--use_amp true
--fp16_opt_level O2
--max_lr 0.0001
--min_lr 0.00001
--max_steps 1000000
--save_steps 50000
--checkpoint_steps 5000
--decay_steps 990000
--weight_decay 0.01
--warmup_rate 0.01
--grad_clip 1.0
--logging_freq 20
--num_workers 2
--eval_freq 1000
--device "gpu"
--share_folder false \

@ZTurboX ZTurboX added the bug Something isn't working label Aug 15, 2023
@w5688414
Copy link
Contributor

w5688414 commented May 8, 2024

升级一下paddle和paddlenlp试一试

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

No branches or pull requests

3 participants