Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 4, 2024

• hotfix

  Guitaricet

  committed
  176f376

  Copy full SHA for 176f376

• make pretokenization with --take work without loading full dataset first

  Guitaricet

  committed
  4dab622

  Copy full SHA for 4dab622

• hotfix

  Guitaricet

  committed
  5c5c42d

  Copy full SHA for 5c5c42d

• Merge branch 'main' of github.com:Guitaricet/relora into main

  Guitaricet

  committed
  ba7769d

  Copy full SHA for ba7769d

• Add option to select a specific number of examples from the dataset in pretokenize.py

  Guitaricet

  committed
  22c1c2c

  Copy full SHA for 22c1c2c

• Update README.md

  Guitaricet

  authored
  b7b7c58

  Copy full SHA for b7b7c58

Commits on Jan 3, 2024

• Update requirements.txt

  Guitaricet

  authored
  c5094fc

  Copy full SHA for c5094fc

• Update README.md

  Guitaricet

  authored
  d7b2d15

  Copy full SHA for d7b2d15

Commits on Nov 8, 2023

• Merge branch 'dev'

  Guitaricet

  committed
  d8ff7ee

  Copy full SHA for d8ff7ee

Commits on Sep 28, 2023

• Merge branch 'dev' of github.com:Guitaricet/relora into dev

  Guitaricet

  committed
  3d2581f

  Copy full SHA for 3d2581f

• hotfix dataset rewinding

  Guitaricet

  committed
  1b95841

  Copy full SHA for 1b95841

• hotfix

  Guitaricet

  committed
  7f43aab

  Copy full SHA for 7f43aab

• fix optimizer reset and relora logic

  Guitaricet

  committed
  7bce45b

  Copy full SHA for 7bce45b

• log optimizer resets, add --skip_batches

  Guitaricet

  committed
  c9604b3

  Copy full SHA for c9604b3

Commits on Sep 27, 2023

• fix scheduler bug

  Guitaricet

  committed
  7de6fb0

  Copy full SHA for 7de6fb0

Commits on Sep 26, 2023

• Merge changes between ml1 and stability

  Guitaricet

  committed
  8c5d2ad

  Copy full SHA for 8c5d2ad

• remove empty_cache

  Guitaricet

  committed
  d002bd7

  Copy full SHA for d002bd7

• disable watch by default

  Guitaricet

  committed
  30a97e4

  Copy full SHA for 30a97e4

Commits on Sep 25, 2023

• add --lora_alpha

  Guitaricet

  committed
  6eb9518

  Copy full SHA for 6eb9518

Commits on Sep 22, 2023

• hotfix lora only

  Guitaricet

  committed
  6417ae5

  Copy full SHA for 6417ae5

Commits on Sep 21, 2023

• rollback flash attn 2, allow cycle len != relora

  Guitaricet

  committed
  abfef36

  Copy full SHA for abfef36

Commits on Sep 20, 2023

• hotfix: rm old flash2 imports

  Show description for 68e5ca1
  Guitaricet

  committed
  68e5ca1

  Copy full SHA for 68e5ca1

• minor scheduler hotfix

  Show description for ac33a08
  Guitaricet

  committed
  ac33a08

  Copy full SHA for ac33a08

• flash attention 2 by default

  Guitaricet

  committed
  5e26ad6

  Copy full SHA for 5e26ad6

Commits on Sep 2, 2023

• add flash attention 2 support (optional for now)

  Guitaricet

  committed
  15cf7b1

  Copy full SHA for 15cf7b1

• add delete old checkpoints

  Show description for ff2cc53
  Guitaricet

  committed
  ff2cc53

  Copy full SHA for ff2cc53

Commits on Aug 29, 2023

• add 8bit quantization support

  Show description for fbe45d5
  Guitaricet

  committed
  fbe45d5

  Copy full SHA for fbe45d5

Commits on Aug 14, 2023

• skip NaN batches

  Guitaricet

  committed
  96aa492

  Copy full SHA for 96aa492

Commits on Aug 13, 2023

• minor fixes

  Guitaricet

  committed
  3784fb4

  Copy full SHA for 3784fb4

Commits on Aug 9, 2023

• use older version of run_glue to be compatible with transformers 4.31.0

  Guitaricet

  committed
  0e7e9fe

  Copy full SHA for 0e7e9fe

• add evaluate to requirements

  Guitaricet

  committed
  c7c58f9

  Copy full SHA for c7c58f9

• add run_glue.py

  Guitaricet

  committed
  1f8e0c7

  Copy full SHA for 1f8e0c7

Commits on Aug 8, 2023

• hotfix merge_and_reinit

  Guitaricet

  committed
  f9d0b9e

  Copy full SHA for f9d0b9e

• eval before merge and reinit

  Guitaricet

  committed
  3af9c86

  Copy full SHA for 3af9c86

• hotfix quantization

  Guitaricet

  committed
  04b1d6f

  Copy full SHA for 04b1d6f

Pagination

Previous

Next