Commits

Breadcrumbs

History for

on00cf764

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 19, 2022

• Adding DeepSpeed Compression Composer (#2105)

  Show description for 0f4f2f9
  

  7 peopleauthored
  0f4f2f9

Commits on Jul 18, 2022

• Add Inference support for running the BigScience-BLOOM Architecture (#2083)

  Show description for aa88137
  

  3 peopleauthored
  aa88137

Commits on Jul 8, 2022

• Codeowner addendum and fix to small model debugging script (#2076)

  Show description for 50a652e
  samadejacobs

  authored
  50a652e

Commits on Jun 23, 2022

• Fix for AMD unit tests (#2047)

  Show description for 7bae53d
  mrwyattii

  authored
  7bae53d

• Fix the half-precision version of CPU-Adam (#2032)

  Show description for a04480e
  

  4 peopleauthored
  a04480e

Commits on Jun 21, 2022

• Retain available params until last use (#2016)

  Show description for 2a1a409
  tjruwase

  authored
  2a1a409

• Fix inference unit test import error catching (#2024)

  Show description for ec1ec20
  

  3 peopleauthored
  ec1ec20

Commits on Jun 16, 2022

• DeepSpeed Monitor Module (Master) (#2013)

  Show description for c87f6ee
  

  Quentin-Anthony

  and

  jeffra

  authored
  c87f6ee

Commits on Jun 15, 2022

• [inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j) (#1992)

  Show description for b666d5c
  

  4 peopleauthored
  b666d5c

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

Commits on Jun 6, 2022

• Add torch-latest and torch-nightly CI workflows (#1990)

  Show description for 7fc3065
  

  mrwyattii

  and

  jeffra

  authored
  7fc3065

Commits on May 31, 2022

• Add unit test for various model families and inference tasks (#1981)

  Show description for 5d3c671
  

  mrwyattii

  and

  jeffra

  authored
  5d3c671

Commits on May 24, 2022

• Fixing several bugs in the inference-api and the kernels (#1951)

  Show description for 8164ea9
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  8164ea9

Commits on May 11, 2022

• Fairseq support (#1915)

  jeffra

  authored
  5089345

Commits on May 9, 2022

• fix step in adam (#1823)

  Show description for de88718
  

  3 peopleauthored
  de88718

Commits on Apr 26, 2022

• [zero-3] add bwd support for list/dict types returned in fwd (#1857)

  jeffra

  authored
  a52cbf8

Commits on Apr 19, 2022

• fix file ordering (#1822)

  Show description for 801c172
  

  3 peopleauthored
  801c172

Commits on Mar 17, 2022

• fix: Fix undefined variable in _create_expert_data_and_model_parallel and make it easier to understand (#1826)

  Show description for 1e61c7a
  

  shjwudp

  and

  jeffra

  authored
  1e61c7a

Commits on Mar 16, 2022

• [ZeRO-1] fix bug w. cpu-offload + > 1 GPU (#1841)

  jeffra

  authored
  28434c0

Commits on Mar 11, 2022

• 01 adam optimizer (#1790)

  Show description for b80e562
  

  3 peopleauthored
  b80e562

Commits on Mar 3, 2022

• AMD support (#1430)

  Show description for c3c8d5d
  

  6 peopleauthored
  c3c8d5d

Commits on Feb 28, 2022

• Refactor MoE and Groups API to simplify model creation and mangement (#1798)

  Show description for c0af6d9
  

  3 peopleauthored
  c0af6d9

Commits on Feb 15, 2022

• [save_16bit_model] add missing prologue (#1741)

  Show description for baef92e
  

  stas00

  and

  tjruwase

  authored
  baef92e

Commits on Feb 11, 2022

• Prepare zero-3 optimizer for ckpt load/save (#1750)

  Show description for 5fe5b38
  

  tjruwase

  and

  jeffra

  authored
  5fe5b38

• fix pytest issue (#1764)

  jeffra

  authored
  56eac38

Commits on Jan 26, 2022

• Add a very simple PyTorch Lightning test! (#1726)

  Show description for df724e7
  

  Sean Naren

  authored
  df724e7

Commits on Jan 22, 2022

• Add codespell to pre-commit checks (#1717)

  aphedges

  authored
  4cf970e

Commits on Jan 21, 2022

• Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)

  Show description for 4912e0a
  

  5 peopleauthored
  4912e0a

Commits on Jan 19, 2022

• MoE inference + PR-MoE model support (#1705)

  Show description for e46d808
  

  5 peopleauthored
  e46d808

Commits on Jan 14, 2022

• [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525)

  Show description for 3293cf7
  

  jeffra

  and

  tjruwase

  authored
  3293cf7

Commits on Jan 7, 2022

• add segfault guard for cpu-adam/adagrad (#1681)

  jeffra

  authored
  2422ec4

Commits on Dec 14, 2021

• Add tensor methods in flops counting and separate macs and flops (#1591)

  Show description for 082f392
  

  cli99

  and

  jeffra

  authored
  082f392

• [testing] 3x faster unit tests (#1636)

  jeffra

  authored
  7f58853

• Refactor ZeRO naming to reduce confusion (#1607)

  Show description for 1d295ff
  

  jeffra

  and

  tjruwase

  authored
  1d295ff

Commits on Dec 1, 2021

• Transformer kernel/fix layer norm (#1587)

  Show description for 8e891aa
  

  RezaYazdaniAminabadi

  and

  tjruwase

  authored
  8e891aa

Pagination

PreviousNext