Commits

Breadcrumbs

History for

on00cf764

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 1, 2021

• Improve pre-commit hooks (#1602)

  Show description for fc2f378
  

  aphedges

  and

  jeffra

  authored
  fc2f378

Commits on Nov 29, 2021

• force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

  jeffra

  authored
  a10e481

Commits on Nov 19, 2021

• Enables ZeRO-3 inference (#1514)

  jeffra

  authored
  2332cb3

Commits on Nov 16, 2021

• Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse (#1562)

  Show description for 4bf4ab7
  

  3 peopleauthored
  4bf4ab7

Commits on Nov 13, 2021

• Autotuning (#1554)

  Show description for 9caa74e
  

  4 peopleauthored
  9caa74e

Commits on Nov 12, 2021

• Add warmup_type arguments in WarmupLR and WarmupDecayLR (#1530)

  Show description for 76847f4
  

  3 peopleauthored
  76847f4

Commits on Nov 8, 2021

• [unit tests] allow unique port for tests

  jeffra

  committed
  0af15b9

Commits on Nov 1, 2021

• Bfloat16 zero2 (#1398)

  Show description for 648f7bf
  

  raamjad

  and

  tjruwase

  authored
  648f7bf

Commits on Oct 31, 2021

• Transformer kernel - fix unit test (#1503)

  Show description for 2c5bba6
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  2c5bba6

Commits on Oct 29, 2021

• Fix OneCycleLR zero division error (#1498)

  Show description for db5d8ba
  AnesBenmerzoug

  authored
  db5d8ba

Commits on Oct 26, 2021

• Proposal of how we might use sparse tensors for gradients (#1484)

  Show description for fcb3ca5
  

  Dipet

  and

  jeffra

  authored
  fcb3ca5

• Add cpu adagrad (#1358)

  Show description for 8abdaee
  

  3 peopleauthored
  8abdaee

Commits on Oct 22, 2021

• add moe+zero ckpt unit test. (#1429)

  Show description for 0b77d1d
  awan-10

  authored
  0b77d1d

Commits on Oct 6, 2021

• Fix typo (ValueError) (#1434)

  Show description for d8e9ef6
  

  rpengms

  and

  jeffra

  authored
  d8e9ef6

• Fix the workspace allocation for the transformer kernel (#1397)

  Show description for bc7778e
  RezaYazdaniAminabadi

  authored
  bc7778e

Commits on Oct 4, 2021

• Revise param_shapes to be a list of ordered dict (#1424)

  Show description for dd0c8fa
  

  4 peopleauthored
  dd0c8fa

Commits on Oct 2, 2021

• Fix many typos (#1423)

  Show description for be789b1
  

  aphedges

  and

  tjruwase

  authored
  be789b1

Commits on Oct 1, 2021

• Add assert to ensure we don't skip unsupported grad dtypes (#1418)

  jeffra

  authored
  0457bb1

Commits on Sep 29, 2021

• Big science related changes (#1407)

  Show description for e2fdd25
  

  7 peopleauthored
  e2fdd25

Commits on Sep 28, 2021

• [CI] install fix for HF tests and use dict instead of json for some tests (#1405)

  Show description for 9e5c0c5
  jeffra

  authored
  9e5c0c5

Commits on Sep 22, 2021

• [zero_to_fp32] fix padding removal (#1380)

  Show description for 364994a
  

  stas00

  and

  jeffra

  authored
  364994a

Commits on Sep 21, 2021

• Sparse attn triton v1.0 support + torch1.8 test runner (#1374)

  Show description for 6996bb0
  

  jeffra

  and

  Reza Yazdani

  authored
  6996bb0

Commits on Sep 16, 2021

• [zero_to_fp32] adapt to 4-bytes alignment in z2 (#1372)

  Show description for 30537e7
  

  stas00

  and

  tjruwase

  authored
  30537e7

Commits on Sep 9, 2021

• Added 4-byte alignment on NCCL/RCCL (#1328)

  Show description for 2c62843
  

  3 peopleauthored
  2c62843

Commits on Sep 1, 2021

• Added drop_last to DeepSpeedDataLoader (#1321)

  Show description for c0b27fb
  

  3 peopleauthored
  c0b27fb

Commits on Aug 31, 2021

• Remove duplicate clip grad function in deepspeed (#1333)

  Show description for ddffbae
  awan-10

  authored
  ddffbae

Commits on Aug 25, 2021

• Support Callable type for client optimizer and lr_scheduler (#1316)

  Show description for 274c375
  tjruwase

  authored
  274c375

Commits on Aug 18, 2021

• Updating the torch version check to numeric (#1314)

  pruthvistony

  authored
  e804f15

Commits on Aug 17, 2021

• DeepSpeed MoE (#1310)

  Show description for f284324
  

  10 peopleauthored
  f284324

Commits on Aug 16, 2021

• Curriculum learning (#1307)

  Show description for b2b34ae
  

  conglongli

  and

  jeffra

  authored
  b2b34ae

Commits on Aug 2, 2021

• ZeRO-1 empty grads fix + tests (#1273)

  Show description for adc21a4
  jeffra

  authored
  adc21a4

Commits on Jul 28, 2021

• Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_length*heads values (#1239)

  Show description for bfe7f0d
  

  3 peopleauthored
  bfe7f0d

Commits on Jul 20, 2021

• [zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240)

  Show description for 7392e45
  stas00

  authored
  7392e45

Commits on Jul 14, 2021

• [zero3] fix reference counting in backward over multiple forwards (#1227)

  Show description for 3fa2420
  stas00

  authored
  3fa2420

Commits on Jul 9, 2021

• [zero.Init] post_init partitining is to be run only by a child module (#1202)

  Show description for 497b741
  

  stas00

  and

  tjruwase

  authored
  497b741

Pagination

PreviousNext