Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 14, 2026

• Fix MoE launch scripts (#110)

  odashi

  authored
  24f14cc

  Copy full SHA for 24f14cc

• 8b phase2 config (#111)

  odashi

  authored
  701b378

  Copy full SHA for 701b378

Commits on Dec 12, 2025

• V4 moe ckpt convert (#109)

  Taishi-N324

  authored
  0c48408

  Copy full SHA for 0c48408

• Refine merge script (#92)

  odashi

  authored
  6526da5

  Copy full SHA for 6526da5

Commits on Dec 10, 2025

• Add v4 dense configs (#106)

  odashi

  authored
  3bc1dde

  Copy full SHA for 3bc1dde

• move moe script dir (#108)

  odashi

  authored
  1d65636

  Copy full SHA for 1d65636

• V4 32b a3.8b phase1 (#107)

  Taishi-N324

  authored
  713bf38

  Copy full SHA for 713bf38

Commits on Dec 8, 2025

• V4 moe (#105)

  Taishi-N324

  authored
  8ae3ee4

  Copy full SHA for 8ae3ee4

• refine training scripts (#95)

  odashi

  authored
  d8a675b

  Copy full SHA for d8a675b

Commits on Sep 24, 2025

• Add scripts to run minhash deduplication for Japanese corpus (#71)

  Show description for 8123cf2
  

  ytivy

  and

  Yuma Tsuta

  authored
  8123cf2

  Copy full SHA for 8123cf2

Commits on Aug 28, 2025

• fix ckpt-converter readme (#96)

  odashi

  authored
  d784412

  Copy full SHA for d784412

Commits on Aug 27, 2025

• ckpt conversion on cpu (#91)

  Show description for 7de4c40
  cr-liu

  authored
  7de4c40

  Copy full SHA for 7de4c40

• add NUM_NODES variable to converter launcher (#93)

  odashi

  authored
  615031e

  Copy full SHA for 615031e

Commits on Aug 17, 2025

• 0175 merge megatron upstream (#85)

  so298

  authored
  977fe59

  Copy full SHA for 977fe59

Commits on Jul 7, 2025

• Resolved installation error of llm-jp-eval (1.4.1) due to broken link (#88)

  k141303

  authored
  dafb2af

  Copy full SHA for dafb2af

Commits on Jun 30, 2025

• simplify train_data and fix converter (#87)

  odashi

  authored
  b5c1b7c

  Copy full SHA for b5c1b7c

Commits on Jun 23, 2025

• V4 corpus ratio abci (#86)

  odashi

  authored
  eb10c0c

  Copy full SHA for eb10c0c

Commits on Jun 17, 2025

• Fix v4-megatron-abci installer (#84)

  odashi

  authored
  ada19f6

  Copy full SHA for ada19f6

Commits on Jun 12, 2025

• LLMjp v4 Midtraining (ref: OLMo2 midtrainig) (#79)

  Show description for d39d900
  

  koshieguchi

  and

  so298

  authored
  d39d900

  Copy full SHA for d39d900

Commits on May 16, 2025

• add pretraining installer for abci 3.0 (#82)

  Taka008

  authored
  cb0bb7e

  Copy full SHA for cb0bb7e

• add 980m scripts (#63)

  odashi

  authored
  967826e

  Copy full SHA for 967826e

Commits on May 11, 2025

• Add scripts for training a 13B dense model trained on llm-jp-corpus-v4-hq-3.5t (#80)

  hkiyomaru

  authored
  e0f3561

  Copy full SHA for e0f3561

Commits on May 9, 2025

• V4 general training scripts (#81)

  odashi

  authored
  c5fcf67

  Copy full SHA for c5fcf67

Commits on Mar 28, 2025

• V4 Corpus stats (#75)

  odashi

  authored
  a248a3e

  Copy full SHA for a248a3e

Commits on Mar 26, 2025

• Add scripts to process patent data (#70)

  ytivy

  authored
  2326c13

  Copy full SHA for 2326c13

Commits on Feb 25, 2025

• add v4 scripts (#69)

  odashi

  authored
  73ba7c1

  Copy full SHA for 73ba7c1

Commits on Jan 30, 2025

• Add megatron moe pretrain (#68)

  Taishi-N324

  authored
  b0b92ce

  Copy full SHA for b0b92ce

Commits on Jan 27, 2025

• Add scrips to filter out fineweb-edu-score-2 from fineweb (#66)

  k141303

  authored
  e48d665

  Copy full SHA for e48d665

Commits on Jan 21, 2025

• Add script to split fineweb-edu-score-2 corpus (#65)

  k141303

  authored
  72c52be

  Copy full SHA for 72c52be

Commits on Nov 11, 2024

• Add tokenize shell scripts (#61)

  ytivy

  authored
  061fad0

  Copy full SHA for 061fad0

Commits on Oct 30, 2024

• Update high qulaity cpt scripts (fix scripts and add exp C, D and E) (#58)

  Show description for 7466088
  

  ytivy

  and

  Yuma Tsuta

  authored
  7466088

  Copy full SHA for 7466088

Commits on Oct 28, 2024

• Make installed llm-jp-eval editable (#60)

  odashi

  authored
  5d06140

  Copy full SHA for 5d06140

Commits on Oct 27, 2024

• Update wandb version (>=0.18.0) (#54)

  ytivy

  authored
  db947c1

  Copy full SHA for db947c1

Commits on Oct 26, 2024

• Add 13B CPT configs: exp2 and exp5. (#56)

  odashi

  authored
  3e1dd00

  Copy full SHA for 3e1dd00

Commits on Oct 23, 2024

• Add scripts to install v3 pre-training environment for llm-jp-nvlink cluster (#53)

  ytivy

  authored
  3709cc0

  Copy full SHA for 3709cc0

Pagination

Previous

Next