Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Aug 31, 2023

• update dpo prediction

  sunzeyeah

  committed
  4a48044

  Copy full SHA for 4a48044

Commits on Aug 30, 2023

• replace loading reference model with pre-computed reference logps

  sunzeyeah

  committed
  fc5ef7b

  Copy full SHA for fc5ef7b

• correct typo

  sunzeyeah

  committed
  5b5ec91

  Copy full SHA for 5b5ec91

• add dpo training (alternative to rlhf)

  sunzeyeah

  committed
  c70c968

  Copy full SHA for c70c968

Commits on Aug 9, 2023

• update prediction

  sunzeyeah

  committed
  49047c5

  Copy full SHA for 49047c5

• update prediction in reward

  sunzeyeah

  committed
  65462a2

  Copy full SHA for 65462a2

Commits on Aug 7, 2023

• add best metric for sft and reward training

  sunzeyeah

  committed
  44dd3cf

  Copy full SHA for 44dd3cf

Commits on Jul 28, 2023

• update sft and pretrain scripts

  sunzeyeah

  committed
  b95630a

  Copy full SHA for b95630a

Commits on Jul 25, 2023

• unify model loading by from_pretrained()

  sunzeyeah

  committed
  514d7fa

  Copy full SHA for 514d7fa

Commits on Jul 24, 2023

• update train_sft.py

  sunzeyeah

  committed
  4bc0262

  Copy full SHA for 4bc0262

Commits on Jul 4, 2023

• update eval_pretrain

  sunzeyeah

  committed
  c6a4489

  Copy full SHA for c6a4489

• add truncation to C-Eval and MMLU

  sunzeyeah

  committed
  1bb6d52

  Copy full SHA for 1bb6d52

Commits on Jul 3, 2023

• debug eval_pretrain.py for C-Eval and MMLU

  sunzeyeah

  committed
  71eacf0

  Copy full SHA for 71eacf0

• update eval_pretrain.py

  sunzeyeah

  committed
  e4b65c3

  Copy full SHA for e4b65c3

• add CEval and MMLU in eval_pretrain.py

  sunzeyeah

  committed
  6ec2865

  Copy full SHA for 6ec2865

Commits on Jun 19, 2023

• update loading tokenizer in pretrain.py

  sunzeyeah

  committed
  6415974

  Copy full SHA for 6415974

• update pred in pretrain.py

  sunzeyeah

  committed
  7329176

  Copy full SHA for 7329176

Commits on Jun 16, 2023

• update for scheduler

  sunzeyeah

  committed
  4da8d1c

  Copy full SHA for 4da8d1c

• update evaluation strategy

  sunzeyeah

  committed
  081290e

  Copy full SHA for 081290e

• add evaluation in pretrain

  sunzeyeah

  committed
  437d61d

  Copy full SHA for 437d61d

Commits on Jun 15, 2023

• use onecyle scheduler for pretrain w/o trainer

  sunzeyeah

  committed
  331c753

  Copy full SHA for 331c753

Commits on Jun 14, 2023

• fix circular import

  sunzeyeah

  committed
  356068d

  Copy full SHA for 356068d

Commits on Jun 13, 2023

• add monitoring in pretrain w/o trainer

  sunzeyeah

  committed
  52356ed

  Copy full SHA for 52356ed

Commits on Jun 10, 2023

• update src/models/llama.py

  sunzeyeah

  committed
  e8a7403

  Copy full SHA for e8a7403

• add pretrain w/o trainer

  sunzeyeah

  committed
  9eae1da

  Copy full SHA for 9eae1da

Commits on Jun 1, 2023

• debug pretrain of llama

  sunzeyeah

  committed
  cfafb18

  Copy full SHA for cfafb18

• update pretrain of llama

  sunzeyeah

  committed
  5428102

  Copy full SHA for 5428102

Commits on May 31, 2023

• add pretrain code

  sunzeyeah

  committed
  f179d6d

  Copy full SHA for f179d6d

Commits on Apr 26, 2023

• update RLHFDataset and PPODataset

  sunzeyeah

  committed
  d55f57a

  Copy full SHA for d55f57a

Commits on Apr 25, 2023

• debug train_rlhf_new.py

  sunzeyeah

  committed
  02d5495

  Copy full SHA for 02d5495

Commits on Apr 10, 2023

• debug reward training for chatglm and glm

  sunzeyeah

  committed
  01bc8ee

  Copy full SHA for 01bc8ee

Commits on Apr 7, 2023

• update training scripts

  sunzeyeah

  committed
  1ef7828

  Copy full SHA for 1ef7828

Commits on Apr 6, 2023

• update scripts

  sunzeyeah

  committed
  ecd6b98

  Copy full SHA for ecd6b98

Commits on Mar 31, 2023

• update scripts and configs

  sunzeyeah

  committed
  6ab44d6

  Copy full SHA for 6ab44d6

Commits on Mar 30, 2023

• update rlhf scripts

  sunzeyeah

  committed
  aad731e

  Copy full SHA for aad731e