Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 22, 2023

• Switching run_mlm to xla, wrapping things

  dchaplinsky

  committed
  c2305e1

Commits on Oct 16, 2023

• Making another try with gpt2

  dchaplinsky

  committed
  28067ec

• Trying a full run with a longer warmup

  dchaplinsky

  committed
  181c2f2

Commits on Oct 9, 2023

• Down, down the rabbit hole

  dchaplinsky

  committed
  bfb4780

Commits on Oct 7, 2023

• Trying to squeeze out more of roberta

  dchaplinsky

  committed
  8c2f2bf

Commits on Oct 3, 2023

• Fixing configs, adding two more for rerun on base and large robertas

  dchaplinsky

  committed
  a2b46e4

Commits on Oct 2, 2023

• Adding changes for configs from tpu's

  dchaplinsky

  committed
  dbed625

Commits on Sep 30, 2023

• Squeezing more loss from roberta.large using finetuning

  dchaplinsky

  committed
  582864b

Commits on Sep 28, 2023

• Trying to squeeze out more from roberta

  dchaplinsky

  committed
  fdabd1b

Commits on Sep 27, 2023

• Trying to find a better regime for fine-tuning

  dchaplinsky

  committed
  b8abc8b

Commits on Sep 23, 2023

• Let's try reruns and roberta-large

  dchaplinsky

  committed
  f98e0e8

Commits on Sep 13, 2023

• drat-drat

  dchaplinsky

  committed
  b54e931

Commits on Sep 12, 2023

• Trying gpt2 on tpu

  dchaplinsky

  committed
  3a6ee1d

• Adding sophia and xla support to run_clm, removing old scripts

  dchaplinsky

  committed
  d40a42a

Commits on Sep 10, 2023

• Trying to recreate cuda most successful

  dchaplinsky

  committed
  85a5a0a

Commits on Sep 9, 2023

• Trying inverse_sqrt

  dchaplinsky

  committed
  effbf46

• Revert "Trying inverse_sqrt"

  dchaplinsky

  committed
  9c806a4

• Trying inverse_sqrt

  dchaplinsky

  committed
  1cb62b0

Commits on Sep 4, 2023

• Playing with LR

  dchaplinsky

  committed
  78c0749

• Trying to leverage bf16 memory reqs

  dchaplinsky

  committed
  9f313ee

Commits on Sep 2, 2023

• Fixing invalid json

  dchaplinsky

  committed
  d403816

• Trying bf16

  dchaplinsky

  committed
  a6043de

• Storing our first successful experiment on TPU

  dchaplinsky

  committed
  ddeb1a8

Commits on Aug 25, 2023

• Adding xla-powered script

  dchaplinsky

  committed
  2099d0c

Commits on Aug 21, 2023

• Another experimental config for roberta on TPU

  dchaplinsky

  committed
  897b3b9

Commits on Aug 18, 2023

• Merge branch 'main' of github.com:lang-uk/ukrainian-wechsel-models

  dchaplinsky

  committed
  36dab4d

• Blacking the clm, adding experimental config for the tpu

  dchaplinsky

  committed
  13cc23f

Commits on Jul 27, 2023

• Update README.md

  dchaplinsky

  authored
  d201829

Commits on Jul 19, 2023

• Another config for Sophia

  dchaplinsky

  committed
  3a11914

Commits on Jul 16, 2023

• Trying cosine now

  dchaplinsky

  committed
  aca7cd8

Commits on Jul 14, 2023

• Another try to tame LR

  dchaplinsky

  committed
  d1ea798

Commits on Jul 12, 2023

• Fixing model name

  dchaplinsky

  committed
  724f519

• Adding new config for smaller warmup on roberta/sophia

  dchaplinsky

  committed
  b0a80a4

Commits on Jul 10, 2023

• Trying smaller LR

  dchaplinsky

  committed
  379b0f5

Commits on Jul 8, 2023

• Amending configs

  dchaplinsky

  committed
  7a45d5f

Pagination

PreviousNext