We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
- paddlepaddle:2.5.1 - paddlepaddle-gpu: 2.5.1 - paddlenlp: develop
用最新的paddlenlp develop增量预训练ernie-3.0-tiny-micro-v2-zh会报错TypeError: init() got an unexpected keyword argument 'enable_recompute'
训练脚本 python -u -m paddle.distributed.launch --gpus "0,1" --log_dir "output/ernie-3.0-tiny-micro-v2-zh/log" run_pretrain.py --model_type "ernie" --model_name_or_path "./ernie-3.0-tiny-micro-v2-zh" --tokenizer_name_or_path "./ernie-3.0-tiny-micro-v2-zh" --input_dir "./train_data" --output_dir "output/ernie-3.0-tiny-micro-v2-zh" --split 949,50,1 --max_seq_len 512 --micro_batch_size 16 --use_amp true --fp16_opt_level O2 --max_lr 0.0001 --min_lr 0.00001 --max_steps 1000000 --save_steps 50000 --checkpoint_steps 5000 --decay_steps 990000 --weight_decay 0.01 --warmup_rate 0.01 --grad_clip 1.0 --logging_freq 20 --num_workers 2 --eval_freq 1000 --device "gpu" --share_folder false \
The text was updated successfully, but these errors were encountered:
升级一下paddle和paddlenlp试一试
Sorry, something went wrong.
wawltor
No branches or pull requests
软件环境
重复问题
错误描述
稳定复现步骤 & 代码
训练脚本
python -u -m paddle.distributed.launch
--gpus "0,1"
--log_dir "output/ernie-3.0-tiny-micro-v2-zh/log"
run_pretrain.py
--model_type "ernie"
--model_name_or_path "./ernie-3.0-tiny-micro-v2-zh"
--tokenizer_name_or_path "./ernie-3.0-tiny-micro-v2-zh"
--input_dir "./train_data"
--output_dir "output/ernie-3.0-tiny-micro-v2-zh"
--split 949,50,1
--max_seq_len 512
--micro_batch_size 16
--use_amp true
--fp16_opt_level O2
--max_lr 0.0001
--min_lr 0.00001
--max_steps 1000000
--save_steps 50000
--checkpoint_steps 5000
--decay_steps 990000
--weight_decay 0.01
--warmup_rate 0.01
--grad_clip 1.0
--logging_freq 20
--num_workers 2
--eval_freq 1000
--device "gpu"
--share_folder false \
The text was updated successfully, but these errors were encountered: