Cherry pick some changes from incubate branch

[sneaxiy]

PR types

Bug fixes

PR changes

Others

Description

Cherry pick some changes from incubate branch. The PRs include #8837, #8846, #8851 .

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 8.79121% with 83 lines in your changes missing coverage. Please review.

Project coverage is 55.38%. Comparing base (77480a0) to head (2049374).

❗ Current head 2049374 differs from pull request most recent head 6699d74

Please upload reports for the commit 6699d74 to get more accurate results.

Files	Patch %	Lines
paddlenlp/trainer/utils/reshard/sharding_v2.py	11.11%	40 Missing ⚠️
paddlenlp/trainer/utils/sharding_io.py	7.40%	25 Missing ⚠️
paddlenlp/trainer/trainer.py	7.69%	12 Missing ⚠️
paddlenlp/trainer/training_args.py	0.00%	6 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8862      +/-   ##
===========================================
- Coverage    55.41%   55.38%   -0.04%     
===========================================
  Files          635      631       -4     
  Lines        99917    98653    -1264     
===========================================
- Hits         55370    54639     -731     
+ Misses       44547    44014     -533     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[wawltor]

LGTM