Code

Clean configs documentation#1944

Code

Merged

qgallouedec merged 81 commits intomainhuggingface/trl:mainfrom clean-confighuggingface/trl:clean-configCopy head branch name to clipboardSep 4, 2024

+851-636

Commits

Commits on Aug 18, 2024

• Clean BCO

  qgallouedec

  committed
  c2d9a62

  Copy full SHA for c2d9a62

• Optional[int]

  qgallouedec

  committed
  e3083f1

  Copy full SHA for e3083f1

Commits on Aug 19, 2024

• fix sft config

  qgallouedec

  committed
  c7b2fbc

  Copy full SHA for c7b2fbc

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  e7a80bb

  Copy full SHA for e7a80bb

Commits on Aug 20, 2024

• alignprop config

  qgallouedec

  committed
  50dbc86

  Copy full SHA for 50dbc86

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  b718fba

  Copy full SHA for b718fba

• upadte tempfile to work with output_dir

  qgallouedec

  committed
  4a8aba6

  Copy full SHA for 4a8aba6

• Merge branch 'clean-config' of https://github.com/huggingface/trl into clean-config

  qgallouedec

  committed
  6ae94e9

  Copy full SHA for 6ae94e9

Commits on Aug 21, 2024

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  3ed49fd

  Copy full SHA for 3ed49fd

• clean kto config

  qgallouedec

  committed
  f847f56

  Copy full SHA for f847f56

• intro docstring

  qgallouedec

  committed
  69525f9

  Copy full SHA for 69525f9

• style

  qgallouedec

  committed
  c73f43a

  Copy full SHA for c73f43a

Commits on Aug 22, 2024

• reward config

  qgallouedec

  committed
  11f6e7e

  Copy full SHA for 11f6e7e

• orpo config

  qgallouedec

  committed
  946e2e5

  Copy full SHA for 946e2e5

Commits on Aug 26, 2024

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  21df122

  Copy full SHA for 21df122

• warning in trainer, not in config

  qgallouedec

  committed
  a1bff9c

  Copy full SHA for a1bff9c

• cpo config

  qgallouedec

  committed
  006a454

  Copy full SHA for 006a454

Commits on Aug 27, 2024

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  c9264ee

  Copy full SHA for c9264ee

• ppo v2

  qgallouedec

  committed
  01d8814

  Copy full SHA for 01d8814

• Merge branch 'clean-config' of https://github.com/huggingface/trl into clean-config

  qgallouedec

  committed
  5cd9eef

  Copy full SHA for 5cd9eef

• model config

  qgallouedec

  committed
  9bef508

  Copy full SHA for 9bef508

• ddpo and per_device_train_batch_size (instead of (train_batch_size)

  qgallouedec

  committed
  0a49bca

  Copy full SHA for 0a49bca

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  1c9bba7

  Copy full SHA for 1c9bba7

• rloo

  qgallouedec

  committed
  216856a

  Copy full SHA for 216856a

• Online config

  qgallouedec

  committed
  7270936

  Copy full SHA for 7270936

• tmp_dir in test_ddpo

  qgallouedec

  committed
  05bacaf

  Copy full SHA for 05bacaf

• style

  qgallouedec

  committed
  451b4fc

  Copy full SHA for 451b4fc

Commits on Aug 28, 2024

• remove to_dict and fix post-init

  qgallouedec

  committed
  9e6f0a0

  Copy full SHA for 9e6f0a0

• batch size in test ddpo

  qgallouedec

  committed
  2aa4544

  Copy full SHA for 2aa4544

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  97738c8

  Copy full SHA for 97738c8

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  098ca6a

  Copy full SHA for 098ca6a

• dpo

  qgallouedec

  committed
  02b78ec

  Copy full SHA for 02b78ec

• style

  qgallouedec

  committed
  92ff078

  Copy full SHA for 92ff078

Commits on Aug 29, 2024

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  63679fe

  Copy full SHA for 63679fe

• Args -> Parameters

  qgallouedec

  committed
  4957a8c

  Copy full SHA for 4957a8c

• parameters

  qgallouedec

  committed
  bd3693b

  Copy full SHA for bd3693b

• ppo config

  qgallouedec

  committed
  10468e9

  Copy full SHA for 10468e9

• dont overwrite world size

  qgallouedec

  committed
  d289982

  Copy full SHA for d289982

• style

  qgallouedec

  committed
  d94985a

  Copy full SHA for d94985a

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  1bc063a

  Copy full SHA for 1bc063a

• outputdir in test ppo

  qgallouedec

  committed
  00d2faf

  Copy full SHA for 00d2faf

• output dir in ppo config

  qgallouedec

  committed
  aa98e42

  Copy full SHA for aa98e42

• Merge branch 'clean-config' of https://github.com/huggingface/trl into clean-config

  qgallouedec

  committed
  66dc235

  Copy full SHA for 66dc235

Commits on Sep 3, 2024

• revert non-core change (1/n)

  qgallouedec

  committed
  79234d1

  Copy full SHA for 79234d1

• revert non-core changes (2/n)

  qgallouedec

  committed
  9b3b3a7

  Copy full SHA for 9b3b3a7

• revert non-core change (3/n)

  qgallouedec

  committed
  6aeba64

  Copy full SHA for 6aeba64

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  fc4d223

  Copy full SHA for fc4d223

• uniform max_length

  qgallouedec

  committed
  23fbfc6

  Copy full SHA for 23fbfc6

• fix uniform max_length

  qgallouedec

  committed
  136cfdc

  Copy full SHA for 136cfdc

• beta uniform

  qgallouedec

  committed
  640999c

  Copy full SHA for 640999c

• Merge branch 'clean-config' of https://github.com/huggingface/trl into clean-config

  qgallouedec

  committed
  3d5618c

  Copy full SHA for 3d5618c

• style

  qgallouedec

  committed
  cfe9b22

  Copy full SHA for cfe9b22

• link to ConstantLengthDataset

  qgallouedec

  committed
  358b026

  Copy full SHA for 358b026

• uniform dataset_num_proc

  qgallouedec

  committed
  2190bf1

  Copy full SHA for 2190bf1

• uniform disable_dropout

  qgallouedec

  committed
  5434969

  Copy full SHA for 5434969

• eval_packing doc

  qgallouedec

  committed
  a7e537a

  Copy full SHA for a7e537a

• try latex and α in doc

  qgallouedec

  committed
  1a86078

  Copy full SHA for 1a86078

• try title first

  qgallouedec

  committed
  7065562

  Copy full SHA for 7065562

• doesn't work

  qgallouedec

  committed
  2d93d3d

  Copy full SHA for 2d93d3d

• reorganize doc

  qgallouedec

  committed
  42acd10

  Copy full SHA for 42acd10

• overview

  qgallouedec

  committed
  92a2206

  Copy full SHA for 92a2206

• better latex

  qgallouedec

  committed
  81d5147

  Copy full SHA for 81d5147

• is_encoder_decoder uniform

  qgallouedec

  committed
  71c110a

  Copy full SHA for 71c110a

• proper ticks

  qgallouedec

  committed
  e60c3b0

  Copy full SHA for e60c3b0

• fix latex

  qgallouedec

  committed
  a964090

  Copy full SHA for a964090

• uniform generate_during_eval

  qgallouedec

  committed
  45d4f99

  Copy full SHA for 45d4f99

• uniform truncation_mode

  qgallouedec

  committed
  3bc2d30

  Copy full SHA for 3bc2d30

• ref_model_mixup_alpha

  qgallouedec

  committed
  66a4861

  Copy full SHA for 66a4861

• ref_model_mixup_alpha and ref_model_sync_steps

  qgallouedec

  committed
  e2d8f7f

  Copy full SHA for e2d8f7f

• Uniform model_init_kwargs and ref_model_init_kwargs

  qgallouedec

  committed
  79347d9

  Copy full SHA for 79347d9

• rpo_alpha

  qgallouedec

  committed
  9ba37a9

  Copy full SHA for 9ba37a9

• Update maximum length argument names in config files

  qgallouedec

  committed
  52f69b1

  Copy full SHA for 52f69b1

• Update loss_type descriptions in config files

  qgallouedec

  committed
  0fabc42

  Copy full SHA for 0fabc42

• Update max_target_length to max_completion_length in CPOConfig and CPOTrainer

  qgallouedec

  committed
  e1abc3a

  Copy full SHA for e1abc3a

• Update padding value in config files

  qgallouedec

  committed
  d618f0c

  Copy full SHA for d618f0c

• Update precompute_ref_log_probs flag documentation

  qgallouedec

  committed
  594677c

  Copy full SHA for 594677c

• Fix typos and update comments in dpo_config.py and sft_config.py

  qgallouedec

  committed
  5dee9ab

  Copy full SHA for 5dee9ab

Commits on Sep 4, 2024

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  47431f8

  Copy full SHA for 47431f8

• post init warning for max_target_length

  qgallouedec

  committed
  19af1fa

  Copy full SHA for 19af1fa

• Merge branch 'clean-config' of https://github.com/huggingface/trl into clean-config

  qgallouedec

  committed
  34b38b0

  Copy full SHA for 34b38b0

• Merge branch 'main' into clean-config

  qgallouedec

  authored
  07c9cab

  Copy full SHA for 07c9cab