Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Feb 20, 2025

• Add efficiency scripts (#197)

  Show description for 8c57a0f
  bclavie

  authored
  8c57a0f

  Copy full SHA for 8c57a0f

Commits on Jan 21, 2025

• Remove temporary hardcoded data fix (#184)

  ohallstrom

  authored
  9ef147a

  Copy full SHA for 9ef147a

Commits on Jan 17, 2025

• Add launch and data documentation (#183)

  ohallstrom

  authored
  13762a3

  Copy full SHA for 13762a3

Commits on Dec 21, 2024

• added "created by" attribution (#151)

  ohmeow

  authored
  9e99756

  Copy full SHA for 9e99756

• added "created by" attribution

  ohmeow

  committed
  68f8ed3

  Copy full SHA for 68f8ed3

Commits on Dec 20, 2024

• Fix bug in evaluate_st.py (#144)

  joe32140

  authored
  46cd3a2

  Copy full SHA for 46cd3a2

Commits on Dec 19, 2024

• Adding a Getting Started type finetuning tutorial using Transformers ... (#140)

  ohmeow

  authored
  bb2049a

  Copy full SHA for bb2049a

• fixed capitalization and included note on not requiring flash attention

  ohmeow

  committed
  a5f2276

  Copy full SHA for a5f2276

• adding glue finetuning tutorial

  ohmeow

  committed
  0d8501a

  Copy full SHA for 0d8501a

• add links to answer.ai and lighton.ai (#139)

  warner-benjamin

  authored
  9f43cf6

  Copy full SHA for 9f43cf6

• [`examples`] Add a Sentence Transformers training script on GooAQ (#138)

  Show description for 0e6e886
  tomaarsen

  authored
  0e6e886

  Copy full SHA for 0e6e886

• readme (#137)

  bclavie

  authored
  f973855

  Copy full SHA for f973855

• For release (#136)

  Show description for ff495fe
  

  bclavie

  and

  warner-benjamin

  authored
  ff495fe

  Copy full SHA for ff495fe

Commits on Dec 18, 2024

• Retrieval boilerplates (#135)

  Show description for a5b69e0
  

  NohTow

  and

  tomaarsen

  authored
  a5b69e0

  Copy full SHA for a5b69e0

Commits on Dec 5, 2024

• Pass optimizer to ClassificationJob for all glue jobs (#133)

  ohallstrom

  authored
  90c9d89

  Copy full SHA for 90c9d89

Commits on Nov 25, 2024

• Improve evals helpers (#131)

  Show description for 65e6a33
  warner-benjamin

  authored
  65e6a33

  Copy full SHA for 65e6a33

Commits on Nov 17, 2024

• RopeSchedule & EMA Algorithms (#129)

  Show description for 11fe62e
  warner-benjamin

  authored
  11fe62e

  Copy full SHA for 11fe62e

Commits on Nov 14, 2024

• Add optimizer configuration to eval (#125)

  Show description for 9282efe
  

  ohmeow

  and

  warner-benjamin

  authored
  9282efe

  Copy full SHA for 9282efe

Commits on Oct 24, 2024

• rescaling LR for non-constant schedulers (#128)

  warner-benjamin

  authored
  65f34a0

  Copy full SHA for 65f34a0

Commits on Oct 19, 2024

• Add reset_time option (#127)

  warner-benjamin

  authored
  235821b

  Copy full SHA for 235821b

• allow empty split for train or eval only datasets (#126)

  warner-benjamin

  authored
  594c8ab

  Copy full SHA for 594c8ab

• Add option to strip excess padding from packed sequences. (#117)

  Show description for 553db01
  

  fladhak

  and

  warner-benjamin

  authored
  553db01

  Copy full SHA for 553db01

Commits on Oct 18, 2024

• Live eval support for pre-training runs (#120)

  Show description for 579921b
  

  rbiswasfc

  and

  Raja Biswas

  authored
  579921b

  Copy full SHA for 579921b

Commits on Sep 27, 2024

• Modify the LambdaLR scheduler when overriding the LR & WD (#124)

  warner-benjamin

  authored
  2e658b3

  Copy full SHA for 2e658b3

• Allow setting a new LR & WD on resumption (#123)

  warner-benjamin

  authored
  29cde7d

  Copy full SHA for 29cde7d

• remove callbacks from restart_override (#122)

  warner-benjamin

  authored
  7413d12

  Copy full SHA for 7413d12

• Add restart override flag to allow changing schedule, callbacks, and microbatch_size (#121)

  Show description for 32a977b
  warner-benjamin

  authored
  32a977b

  Copy full SHA for 32a977b

Commits on Sep 10, 2024

• Merge main into init_from_checkpoint

  warner-benjamin

  committed
  53fe219

  Copy full SHA for 53fe219

Commits on Sep 9, 2024

• Initialize model from Checkpoint (#119)

  warner-benjamin

  authored
  f1e335d

  Copy full SHA for f1e335d

• remove poorly performing options

  warner-benjamin

  committed
  3b77926

  Copy full SHA for 3b77926

• add 1-sqrt scheduler for decay experiments (#118)

  staghado

  authored
  5d66964

  Copy full SHA for 5d66964

• load checkpoint to cpu, not rank 0

  warner-benjamin

  committed
  0daeca2

  Copy full SHA for 0daeca2

• remove clamp_weights from tile_norm calls

  warner-benjamin

  committed
  5861d9c

  Copy full SHA for 5861d9c

• remove temp callback

  warner-benjamin

  committed
  8a59b31

  Copy full SHA for 8a59b31

• improvements, appears to work

  warner-benjamin

  committed
  8d1edd5

  Copy full SHA for 8d1edd5

Pagination

Previous

Next