Code

📉 Add PEFT support for PPOTrainer#2344

Code

Merged

qgallouedec merged 14 commits intohuggingface:mainhuggingface/trl:mainfrom ccs96307:feature-ppo-peftccs96307/trl:feature-ppo-peftCopy head branch name to clipboardNov 18, 2024

+188-26

Commits

Commits on Nov 11, 2024

• Add peft/lora support for

  ccs96307

  committed
  2368ce3

• Fix: style

  ccs96307

  committed
  1fbab04

• Merge branch 'main' into feature-ppo-peft

  ccs96307

  committed
  a799e61

• Fix: typo

  ccs96307

  committed
  b98b79c

• Add ppo.py PEFT example

  ccs96307

  committed
  a99c7bf

• Merge branch 'main' into feature-ppo-peft

  qgallouedec

  authored
  f8385d1

Commits on Nov 12, 2024

• Merge remote-tracking branch 'upstream/main' into feature-ppo-peft

  ccs96307

  committed
  dadd984

• Fixed the optional dependencies error

  ccs96307

  committed
  dcbbaf6

• skip peft test if peft is unavailable

  ccs96307

  committed
  3a64635

• Merge branch 'main' into feature-ppo-peft

  ccs96307

  authored
  e088577

Commits on Nov 13, 2024

• Merge branch 'main' into feature-ppo-peft

  ccs96307

  authored
  7e682fc

Commits on Nov 14, 2024

• Update trl/trainer/ppo_trainer.py

  Show description for e44b9c2
  

  ccs96307

  and

  qgallouedec

  authored
  e44b9c2

Commits on Nov 16, 2024

• Merge branch 'main' into feature-ppo-peft

  ccs96307

  authored
  26c3015

Commits on Nov 18, 2024

• Merge branch 'main' into feature-ppo-peft

  qgallouedec

  authored
  4dc7e6f