Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 15, 2025

• [inf] Add config var to enable keeping module on host (#6846)

  Show description for fae714d
  

  3 peopleauthored
  fae714d

  Copy full SHA for fae714d

Commits on Jan 9, 2025

• Add deepseek autotp (#6937)

  Show description for 45fce45
  Yejing-Lai

  authored
  45fce45

  Copy full SHA for 45fce45

Commits on Dec 18, 2024

• Add arctic model support by adding w2 to all_reduce (#6856)

  Show description for 0b25630
  

  3 peopleauthored
  0b25630

  Copy full SHA for 0b25630

Commits on Oct 9, 2024

• Enabled Qwen2-MoE Tensor Parallelism (TP) inference (#6551)

  Show description for 474a328
  

  gyou2021

  and

  loadams

  authored
  474a328

  Copy full SHA for 474a328

Commits on Oct 8, 2024

• Add llama3.2 vision autotp (#6577)

  Show description for e97b453
  

  Yejing-Lai

  and

  loadams

  authored
  e97b453

  Copy full SHA for e97b453

Commits on Jul 23, 2024

• Add chatglm2 & chatglm3 autotp (#5540)

  Show description for 0d3bb77
  

  4 peopleauthored
  0d3bb77

  Copy full SHA for 0d3bb77

• [INF] Add Qwen2RMSNorm to loaded layers in auto_tp (#5786)

  Show description for 830d0c0
  

  oelayan7

  and

  loadams

  authored
  830d0c0

  Copy full SHA for 830d0c0

Commits on Jul 15, 2024

• Fix phi3 mini 128k load error (#5765)

  Show description for a07a3c5
  

  Yejing-Lai

  and

  loadams

  authored
  a07a3c5

  Copy full SHA for a07a3c5

Commits on Jun 18, 2024

• enable yuan autotp & add conv tp (#5428)

  Show description for 8ea995e
  

  4 peopleauthored
  8ea995e

  Copy full SHA for 8ea995e

Commits on May 14, 2024

• Switch from double quotes to match single quotes (#5530)

  loadams

  authored
  62ca317

  Copy full SHA for 62ca317

Commits on May 13, 2024

• enable phi2 autotp (#5436)

  Show description for 3a7f3aa
  

  3 peopleauthored
  3a7f3aa

  Copy full SHA for 3a7f3aa

Commits on May 8, 2024

• enable phi3_mini autotp (#5501)

  Show description for 3dd7ccf
  

  Yejing-Lai

  and

  lekurile

  authored
  3dd7ccf

  Copy full SHA for 3dd7ccf

Commits on Mar 27, 2024

• Enable mixtral 8x7b autotp (#5257)

  Show description for 8d98e17
  

  Yejing-Lai

  and

  loadams

  authored
  8d98e17

  Copy full SHA for 8d98e17

Commits on Jan 19, 2024

• Fix T5 and mistral model meta data error (#4958)

  Show description for e62a47e
  

  Yejing-Lai

  and

  loadams

  authored
  e62a47e

  Copy full SHA for e62a47e

Commits on Jan 12, 2024

• fix uneven issue & add balance autotp (#4697)

  Show description for 29417ab
  

  3 peopleauthored
  29417ab

  Copy full SHA for 29417ab

Commits on Jan 11, 2024

• autoTP for Qwen (#4902)

  Show description for ee7db48
  

  3 peopleauthored
  ee7db48

  Copy full SHA for ee7db48

Commits on Jan 5, 2024

• fix num_kv_heads sharding in uneven autoTP for Falcon-40b (#4712)

  Show description for 1787673
  

  3 peopleauthored
  1787673

  Copy full SHA for 1787673

Commits on Dec 18, 2023

• Inference changes for incorporating meta loading checkpoint (#4692)

  Show description for 4c2cac0
  

  oelayan7

  and

  tjruwase

  authored
  4c2cac0

  Copy full SHA for 4c2cac0

Commits on Dec 15, 2023

• fix falcon model load from_config meta_data error (#4783)

  baodii

  authored
  faa00b1

  Copy full SHA for faa00b1

Commits on Dec 8, 2023

• improve the way to determine whether a variable is None (#4782)

  Show description for 7b818ee
  

  RUAN-ZX

  and

  tjruwase

  authored
  7b818ee

  Copy full SHA for 7b818ee

• fix autoTP issue for mpt (trust_remote_code=True) (#4787)

  Show description for 29f840f
  sywangyi

  authored
  29f840f

  Copy full SHA for 29f840f

Commits on Nov 10, 2023

• fix num_kv_heads sharding in autoTP for the new in-repo Falcon-40B (#4654)

  Show description for 6ea44d0
  

  3 peopleauthored
  6ea44d0

  Copy full SHA for 6ea44d0

Commits on Oct 25, 2023

• [AutoTP] Make AutoTP work when num_heads not divisible by number of workers (#4011)

  Show description for f15cccf
  

  6 peopleauthored
  f15cccf

  Copy full SHA for f15cccf

Commits on Oct 9, 2023

• add lm_head and embed_out tensor parallel (#3962)

  Show description for 6763e2d
  

  Yejing-Lai

  and

  dc3671

  authored
  6763e2d

  Copy full SHA for 6763e2d

Commits on Sep 28, 2023

• fix cpu loading model partition OOM (#4353)

  Show description for 7220e7f
  

  Yejing-Lai

  and

  tjruwase

  authored
  7220e7f

  Copy full SHA for 7220e7f

Commits on Sep 19, 2023

• Add the policy to run llama model from the official repo (#4313)

  Show description for 468882f
  

  3 peopleauthored
  468882f

  Copy full SHA for 468882f

Commits on Aug 24, 2023

• add meta onDevice support for LLAMA2 (#4147)

  Show description for 0712e29
  

  dc3671

  and

  molly-smith

  authored
  0712e29

  Copy full SHA for 0712e29

Commits on Aug 22, 2023

• enable autoTP for mpt in huggingface model hub without trust_remote_code (#4062)

  Show description for 5e16eb2
  

  3 peopleauthored
  5e16eb2

  Copy full SHA for 5e16eb2

Commits on Aug 15, 2023

• Return nn.parameter type for weights and biases (#4146)

  Show description for 341cefd
  molly-smith

  authored
  341cefd

  Copy full SHA for 341cefd

Commits on Aug 4, 2023

• fix typo: change polciies to policies (#4090)

  digger-yu

  authored
  4cde5da

  Copy full SHA for 4cde5da

Commits on Aug 1, 2023

• Refactor autoTP inference for HE (#4040)

  Show description for 94c7233
  molly-smith

  authored
  94c7233

  Copy full SHA for 94c7233

Commits on Jul 27, 2023

• autoTP for fused qkv weight (#3844)

  Show description for 6b877d2
  

  4 peopleauthored
  6b877d2

  Copy full SHA for 6b877d2

Commits on Jul 6, 2023

• Add GPTNeoX AutoTP support (#3778)

  Show description for d6f6221
  

  3 peopleauthored
  d6f6221

  Copy full SHA for d6f6221

Commits on Jul 5, 2023

• Add FALCON Auto-TP Support (#3640)

  Show description for f3c93b0
  

  RezaYazdaniAminabadi

  and

  mrwyattii

  authored
  f3c93b0

  Copy full SHA for f3c93b0

Commits on May 3, 2023

• Enable auto TP policy for llama model (#3170)

  Show description for 2c63e34
  

  3 peopleauthored
  2c63e34

  Copy full SHA for 2c63e34

Pagination

Previous

Next