Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 7, 2023

• Adding the possibility of passing a label dataset (EleutherAI#958)

  Show description for c00ce70
  

  honglu2875

  and

  haileyschoelkopf

  authored
  c00ce70

  Copy full SHA for c00ce70

Commits on Jun 6, 2023

• Updated the HF to Sequential script to be more general (EleutherAI#967)

  Show description for eedf1a8
  

  bentherien

  and

  Quentin-Anthony

  authored
  eedf1a8

  Copy full SHA for eedf1a8

Commits on Jun 5, 2023

• Update HF conversion docs following reversion of is_pipe_parallel check (EleutherAI#959)

  Show description for 7a595f5
  

  haileyschoelkopf

  and

  github-actions

  authored
  7a595f5

  Copy full SHA for 7a595f5

Commits on Jun 4, 2023

• added a simple script for multi-node data preparation. (EleutherAI#802)

  Show description for 460a901
  MLRichter

  authored
  460a901

  Copy full SHA for 460a901

Commits on May 19, 2023

• Adds a script to convert HF checkpoints to NeoX 2.0 with mp and pp sharding (EleutherAI#907)

  Show description for b70d004
  

  bentherien

  and

  Quentin-Anthony

  authored
  b70d004

  Copy full SHA for b70d004

Commits on May 12, 2023

• Re-commit changes (EleutherAI#931)

  Show description for a683a88
  

  4 peopleauthored
  a683a88

  Copy full SHA for a683a88

Commits on May 9, 2023

• [Fix] pre-commit and update-documentation checks

  austinburnett

  committed
  a4e9f24

  Copy full SHA for a4e9f24

Commits on May 2, 2023

• Support for LLaMA (EleutherAI#841)

  Show description for 299b68c
  

  zphang

  and

  Quentin-Anthony

  authored
  299b68c

  Copy full SHA for 299b68c

Commits on Apr 19, 2023

• Fix pre-commit formatting

  Show description for 29b968d
  dashstander

  committed
  29b968d

  Copy full SHA for 29b968d

Commits on Apr 15, 2023

• accept changes from main & resolve conflicts

  satpalsr

  committed
  9c645dd

  Copy full SHA for 9c645dd

Commits on Apr 11, 2023

• fix formatting

  satpalsr

  committed
  45d7052

  Copy full SHA for 45d7052

Commits on Mar 27, 2023

• Add the merge dataset tool from upstream megatron (EleutherAI#855)

  Show description for 5561ff7
  

  3 peopleauthored
  5561ff7

  Copy full SHA for 5561ff7

Commits on Mar 26, 2023

• Upstream DeepSpeed -> HF checkpoint conversion script update (EleutherAI#752)

  Show description for fa46a87
  

  4 peopleauthored
  fa46a87

  Copy full SHA for fa46a87

Commits on Mar 23, 2023

• Minor Usability Fixes for HF Conversion (EleutherAI#853)

  Show description for 8cd55b3
  

  haileyschoelkopf

  and

  github-actions

  authored
  8cd55b3

  Copy full SHA for 8cd55b3

Commits on Mar 14, 2023

• Formatting Cleanup (EleutherAI#832)

  Show description for 3a4af67
  

  3 peopleauthored
  3a4af67

  Copy full SHA for 3a4af67

• Added errors for download failure and also a --force-redownload argument (EleutherAI#820)

  Show description for dd5a53d
  

  3 peopleauthored
  dd5a53d

  Copy full SHA for dd5a53d

Commits on Feb 27, 2023

• Update corpora urls

  

  Huang Liankai

  committed
  8965d4b

  Copy full SHA for 8965d4b

Commits on Jan 31, 2023

• add TiktokenTokenizer

  

  haileyschoelkopf

  committed
  b4784bd

  Copy full SHA for b4784bd

Commits on Jan 18, 2023

• optimize data preprocessing by using numpy

  zhuzilin

  committed
  f255e9b

  Copy full SHA for f255e9b

Commits on Dec 25, 2022

• Enable multiline prompts by setting a custom prompt end (EleutherAI#754)

  Show description for 93f4efd
  

  kabachuha

  and

  Quentin-Anthony

  authored
  93f4efd

  Copy full SHA for 93f4efd

Commits on Dec 9, 2022

• Fix shared LN error in HF conversion script (EleutherAI#738)

  Show description for 589c70a
  

  haileyschoelkopf

  and

  github-actions

  authored
  589c70a

  Copy full SHA for 589c70a

• closing bracket

  xv44586

  authored
  42690e9

  Copy full SHA for 42690e9

Commits on Dec 6, 2022

• Slurm Fix and formatting (EleutherAI#729)

  Show description for ebd47f6
  

  3 peopleauthored
  ebd47f6

  Copy full SHA for ebd47f6

• align gpt-j layernorm to hf (EleutherAI#481)

  Show description for 0accac6
  

  8 peopleauthored
  0accac6

  Copy full SHA for 0accac6

Commits on Dec 2, 2022

• Update upload.py

  StellaAthena

  authored
  9c3b069

  Copy full SHA for 9c3b069

• Update syncdir.sh

  StellaAthena

  authored
  830d267

  Copy full SHA for 830d267

• Update sync_cmd.sh

  StellaAthena

  authored
  5f2f16f

  Copy full SHA for 5f2f16f

• Update sync.sh

  StellaAthena

  authored
  0998643

  Copy full SHA for 0998643

• Update preprocess_data.py

  StellaAthena

  authored
  d555b90

  Copy full SHA for d555b90

• Update merge_mp_partitions.py

  StellaAthena

  authored
  d9c0bac

  Copy full SHA for d9c0bac

• Update merge20b.py

  StellaAthena

  authored
  42ad16b

  Copy full SHA for 42ad16b

• Update inspect_checkpoints.py

  StellaAthena

  authored
  aa3df4d

  Copy full SHA for aa3df4d

• Update corpora.py

  StellaAthena

  authored
  0656b40

  Copy full SHA for 0656b40

• Update convert_to_hf.py

  StellaAthena

  authored
  757bb79

  Copy full SHA for 757bb79

Commits on Nov 27, 2022

• NeoX to HF Model Conversion Script (EleutherAI#701)

  Show description for d2fb95a
  

  5 peopleauthored
  d2fb95a

  Copy full SHA for d2fb95a

Pagination

Previous

Next