Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 6, 2023

• Whach the mole

  dchaplinsky

  committed
  43e0363

• Fixing the model name

  dchaplinsky

  committed
  a934ebd

• Adding support for the SophiaG optimizer in the mlm trainer, adding new config

  dchaplinsky

  committed
  1e17678

Commits on Jul 4, 2023

• Adding new test config

  dchaplinsky

  committed
  907ad8b

Commits on Jul 2, 2023

• Fix for roberta-base wechsel config

  dchaplinsky

  committed
  28f3656

• Merge branch 'main' of github.com:lang-uk/ukrainian-wechsel-models

  dchaplinsky

  committed
  75a15be

• Misc fixes for the mlm and scorer, new config for roberta-base

  dchaplinsky

  committed
  8100b38

Commits on Jun 22, 2023

• Fixing scratch config

  dchaplinsky

  committed
  123bd80

Commits on Jun 18, 2023

• Adding nll/bpp/bpc scorer from @proger

  dchaplinsky

  committed
  252f14c

Commits on Jun 16, 2023

• Wiring the setting

  dchaplinsky

  committed
  55466f2

Commits on Jun 15, 2023

• Rearranging configs

  dchaplinsky

  committed
  b557055

• Fixing scratch config

  dchaplinsky

  committed
  94851f6

• Now trying the base roberta

  dchaplinsky

  committed
  6690729

Commits on Jun 13, 2023

• Introducing malyuk

  dchaplinsky

  committed
  544b1bf

Commits on Jun 8, 2023

• Fuck that extension in particular

  dchaplinsky

  committed
  f4d46ab

• Fuck that json in particulr

  dchaplinsky

  committed
  6807005

• Fuck that partial in particular

  dchaplinsky

  committed
  16bae73

• Fucking datasets

  dchaplinsky

  committed
  781bfd4

Commits on Jun 7, 2023

• Fixing typos

  dchaplinsky

  committed
  4faea73

• Making it work with custom transformers like mpt7b

  dchaplinsky

  committed
  9bd538a

• Trusting remote code for now

  dchaplinsky

  committed
  f0f5b9b

• Adding wandb project setting

  dchaplinsky

  committed
  94c3bf2

• Housekeeping

  dchaplinsky

  committed
  6aca962

• Preparing for the mosaic, making prepare_model.py and run_clm_sophia more robust

  dchaplinsky

  committed
  8c03e31

Commits on Jun 6, 2023

• Now for real

  dchaplinsky

  committed
  370bc5f

• More robust solution for the title

  dchaplinsky

  committed
  1a1b64c

• Stupid bug with comprehension

  dchaplinsky

  committed
  71083ac

• Trying corpus merger

  dchaplinsky

  committed
  3a03f5c

• Another config for sophia: reproducing params from their github

  dchaplinsky

  committed
  0433c44

Commits on Jun 5, 2023

• Another experiment on sophia: cosine LR schedule

  dchaplinsky

  committed
  c467bac

• Updating todo, adding two new optimizers, SophiaG and Lion, changing the run_clm_sophia.py code and sophia config to take into the account the changes in optimizer

  dchaplinsky

  committed
  9fae6cd

Commits on Jun 2, 2023

• Trying Sophia optimizer

  dchaplinsky

  committed
  c55af21

• Aligning the name

  dchaplinsky

  committed
  3fa09a3

• New config, bf16 + la x4

  dchaplinsky

  committed
  6bfb126

• New config for bigger gradient accum

  dchaplinsky

  committed
  9581573

Pagination

PreviousNext