support ktotrainer

[lugimzzz]

PR types

New features

PR changes

APIs

Description

新增KTO Trainer支持

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 10.79812% with 380 lines in your changes missing coverage. Please review.

Project coverage is 52.75%. Comparing base (e5cc07b) to head (7b7b6d3).
Report is 3 commits behind head on release/3.0-beta2.

Files with missing lines	Patch %	Lines
paddlenlp/trl/kto_trainer.py	9.96%	262 Missing ⚠️
paddlenlp/trl/kto_criterion.py	12.71%	103 Missing ⚠️
paddlenlp/transformers/tensor_parallel_utils.py	0.00%	15 Missing ⚠️

Additional details and impacted files

@@                  Coverage Diff                  @@
##           release/3.0-beta2    #9376      +/-   ##
=====================================================
- Coverage              52.90%   52.75%   -0.16%     
=====================================================
  Files                    664      666       +2     
  Lines                 106627   107016     +389     
=====================================================
+ Hits                   56411    56454      +43     
- Misses                 50216    50562     +346     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[wawltor]

LGTM