Commits

Breadcrumbs

History for

onb0f25e9

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 18, 2022

• Add Inference support for running the BigScience-BLOOM Architecture (#2083)

  Show description for aa88137
  

  3 peopleauthored
  aa88137

  Copy full SHA for aa88137

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on May 17, 2022

• Enabling CUDA-graph for the bert-type models (#1952)

  Show description for a5adb90
  

  3 peopleauthored
  a5adb90

  Copy full SHA for a5adb90

Commits on May 11, 2022

• Fairseq support (#1915)

  jeffra

  authored
  5089345

  Copy full SHA for 5089345

Commits on Apr 26, 2022

• Inference PP changes for neox (#1899)

  Show description for b4fcd98
  

  3 peopleauthored
  b4fcd98

  Copy full SHA for b4fcd98

Commits on Jan 19, 2022

• MoE inference + PR-MoE model support (#1705)

  Show description for e46d808
  

  5 peopleauthored
  e46d808

  Copy full SHA for e46d808

Commits on Nov 19, 2021

• Several fixes for our read-the-docs build (#1579)

  jeffra

  authored
  a8a17f2

  Copy full SHA for a8a17f2

Commits on Nov 12, 2021

• Tensor-Parallelism general support (#1512)

  Show description for 9ce00a2
  

  3 peopleauthored
  9ce00a2

  Copy full SHA for 9ce00a2

Commits on Nov 1, 2021

• Bfloat16 zero2 (#1398)

  Show description for 648f7bf
  

  raamjad

  and

  tjruwase

  authored
  648f7bf

  Copy full SHA for 648f7bf

Commits on Aug 25, 2021

• Support Callable type for client optimizer and lr_scheduler (#1316)

  Show description for 274c375
  tjruwase

  authored
  274c375

  Copy full SHA for 274c375

Commits on May 24, 2021

• Quantization + inference release (#1091)

  Show description for ed3de0c
  

  7 peopleauthored
  ed3de0c

  Copy full SHA for ed3de0c

Commits on May 19, 2021

• ZeRO stage 1 refresh (#1042)

  jeffra

  authored
  cfa63f5

  Copy full SHA for cfa63f5

Commits on Apr 29, 2021

• Refactor param_dict to config (#1008)

  Show description for 41ab660
  

  Sean Naren

  and

  jeffra

  authored
  41ab660

  Copy full SHA for 41ab660

Commits on Mar 16, 2021

• Allow args to be optional in deepspeed.initialize (#825)

  jeffra

  authored
  871f304

  Copy full SHA for 871f304

Commits on Mar 8, 2021

• ZeRO 3 Offload (#834)

  Show description for 599258f
  

  6 peopleauthored
  599258f

  Copy full SHA for 599258f

Commits on Jan 14, 2021

• Validate consistent ckpt tags across ranks (#667)

  jeffra

  authored
  f032e56

  Copy full SHA for f032e56

Commits on Dec 18, 2020

• Ability to initialize distributed backend outside deepspeed runtime (#608)

  jeffra

  authored
  7435b2f

  Copy full SHA for 7435b2f

Commits on Nov 19, 2020

• backwards compatability w. v020 ckpts, fix issue with zero-1 ckpts (#543)

  jeffra

  authored
  dce054d

  Copy full SHA for dce054d

Commits on Nov 12, 2020

• DeepSpeed JIT op + PyPI support (#496)

  Show description for 31f46fe
  

  3 peopleauthored
  31f46fe

  Copy full SHA for 31f46fe

Commits on Oct 30, 2020

• Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

  Show description for f5aa254
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  f5aa254

  Copy full SHA for f5aa254

Commits on Sep 10, 2020

• Pipeline parallel training engine. (#392)

  Show description for 65c2f97
  

  Shaden Smith

  and

  jeffra

  authored
  65c2f97

  Copy full SHA for 65c2f97

• ZeRO-Offload release (#391)

  Show description for 41db1c2
  

  9 peopleauthored
  41db1c2

  Copy full SHA for 41db1c2

Commits on Sep 2, 2020

• Sparse attn + ops/runtime refactor + v0.3.0 (#343)

  Show description for e5bbc2e
  

  jeffra

  and

  arashashari

  authored
  e5bbc2e

  Copy full SHA for e5bbc2e

Commits on Jun 4, 2020

• Add log util (#230)

  Show description for e1ad880
  chunyang-wen

  authored
  e1ad880

  Copy full SHA for e1ad880

Commits on May 29, 2020

• Transformer kernel release (#242)

  Show description for 734d899
  

  8 peopleauthored
  734d899

  Copy full SHA for 734d899

Commits on May 19, 2020

• ZeRO-2 (#217)

  Show description for f2ac7ea
  

  8 peopleauthored
  f2ac7ea

  Copy full SHA for f2ac7ea

Commits on Apr 22, 2020

• README and RTD improvements. (#198)

  

  Shaden Smith

  authored
  dd166ee

  Copy full SHA for dd166ee

Commits on Feb 27, 2020

• MPI 3.x support via mpi4py (#107)

  Show description for 7e81328
  jeffra

  authored
  7e81328

  Copy full SHA for 7e81328

Commits on Feb 26, 2020

• Init distributed torch only if needed (#108)

  Show description for 5aa58b3
  jeffra

  authored
  5aa58b3

  Copy full SHA for 5aa58b3

Commits on Feb 24, 2020

• add deprecated deepspeed flag for legacy code (#104)

  jeffra

  authored
  5897091

  Copy full SHA for 5897091

Commits on Feb 20, 2020

• Refactor simple model test, fix pythonpath issue (#96)

  Show description for 001abe2
  jeffra

  authored
  001abe2

  Copy full SHA for 001abe2

• Updating MPU docs (#92)

  

  Shaden Smith

  authored
  2abef1e

  Copy full SHA for 2abef1e

Commits on Feb 10, 2020

• Moving to major/minor/patch versioning. (#51)

  

  Shaden Smith

  authored
  50ae149

  Copy full SHA for 50ae149

Commits on Feb 6, 2020

• Improve doc string for add_XXX_arguments (#32)

  Show description for 8326aff
  tjruwase

  authored
  8326aff

  Copy full SHA for 8326aff

Commits on Feb 3, 2020

• Fixing file permissions (#1)

  Show description for b18eae2
  

  Shaden Smith

  authored
  b18eae2

  Copy full SHA for b18eae2

Pagination

Previous

Next