Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 30, 2026

• Add AutoSP example (#999)

  Show description for 45b4b71
  

  neeldani

  and

  spikerheado1234

  authored
  45b4b71

  Copy full SHA for 45b4b71

Commits on Apr 20, 2025

• Fix DeepCompile benchmark script (#973)

  Show description for 65bc536
  tohtana

  authored
  65bc536

  Copy full SHA for 65bc536

Commits on Apr 18, 2025

• Update description of versions for deepcompile (#971)

  Show description for ce39bf0
  

  tohtana

  and

  loadams

  authored
  ce39bf0

  Copy full SHA for ce39bf0

Commits on Apr 17, 2025

• fix links (#970)

  tohtana

  authored
  93ebac3

  Copy full SHA for 93ebac3

Commits on Apr 16, 2025

• Add example of DeepCompile (#967)

  Show description for b76c7cc
  

  tohtana

  and

  tjruwase

  authored
  b76c7cc

  Copy full SHA for b76c7cc

Commits on Feb 7, 2025

• Update references to deepspeedai GH org (#955)

  Show description for b90ffab
  loadams

  authored
  b90ffab

  Copy full SHA for b90ffab

Commits on Sep 3, 2024

• extend max_prompt_length and input text for 128k evaluation (#891)

  Show description for 1293d45
  

  HeyangQin

  and

  loadams

  authored
  1293d45

  Copy full SHA for 1293d45

Commits on Aug 21, 2024

• Add openai client to deepspeedometer (#913)

  Show description for 9563904
  

  delock

  and

  tjruwase

  authored
  9563904

  Copy full SHA for 9563904

Commits on Aug 16, 2024

• Update README.md (#916)

  keshavkowshik

  authored
  8d91a5a

  Copy full SHA for 8d91a5a

Commits on Aug 14, 2024

• Enable cpu/xpu support for the benchmarking suite (#905)

  Show description for b04fedd
  louie-tsai

  authored
  b04fedd

  Copy full SHA for b04fedd

Commits on Jun 26, 2024

• Refactored LLM benchmark code (#899)

  Show description for bbab278
  mrwyattii

  authored
  bbab278

  Copy full SHA for bbab278

Commits on Jun 6, 2024

• add client-only mode to mii benchmark (#900)

  Show description for 75df1d7
  

  delock

  and

  lekurile

  authored
  75df1d7

  Copy full SHA for 75df1d7

Commits on May 1, 2024

• fix bug with queue.empty not being reliable (#898)

  Show description for cce6223
  mrwyattii

  authored
  cce6223

  Copy full SHA for cce6223

Commits on Apr 30, 2024

• Update tokens_per_sec calculation to work w/ stream and non-stream cases (#897)

  Show description for fdb8ee2
  lekurile

  authored
  fdb8ee2

  Copy full SHA for fdb8ee2

Commits on Apr 29, 2024

• updating tokens per second to include the token count of generated tokens. (#895)

  Show description for 1be0fc7
  

  guptha23

  and

  Chandra Sekhar Gupta Aravapalli

  authored
  1be0fc7

  Copy full SHA for 1be0fc7

Commits on Apr 9, 2024

• Update throughput-latency plot script (#881)

  Show description for fab5d06
  lekurile

  authored
  fab5d06

  Copy full SHA for fab5d06

Commits on Mar 29, 2024

• Fix response check in call_aml function (#882)

  HeyangQin

  authored
  df7119e

  Copy full SHA for df7119e

Commits on Mar 27, 2024

• dynamic setting of requst num and formatting (#880)

  mrwyattii

  authored
  02fc578

  Copy full SHA for 02fc578

Commits on Mar 19, 2024

• change kwargs for AML call to match vllm kwargs (#876)

  mrwyattii

  authored
  279a8fe

  Copy full SHA for 279a8fe

• Improve robustness of infernece AML benchmark (#875)

  HeyangQin

  authored
  18200d5

  Copy full SHA for 18200d5

Commits on Mar 18, 2024

• Update README.md

  awan-10

  authored
  c3ffec2

  Copy full SHA for c3ffec2

Commits on Mar 14, 2024

• Fix AML benchmark E2E measurment (#874)

  Show description for b0a5533
  mrwyattii

  authored
  b0a5533

  Copy full SHA for b0a5533

Commits on Mar 8, 2024

• Xiaoxia/fp v1 (#871)

  Show description for f415ec8
  

  xiaoxiawu-microsoft

  and

  Ubuntu

  authored
  f415ec8

  Copy full SHA for f415ec8

Commits on Mar 6, 2024

• Update Inference Benchmarking Scripts - Support AML (#868)

  Show description for 6e9ada6
  lekurile

  authored
  6e9ada6

  Copy full SHA for 6e9ada6

• Remove AML key from args dict when saving results (#870)

  Show description for b7ec5c3
  lekurile

  authored
  b7ec5c3

  Copy full SHA for b7ec5c3

Commits on Mar 1, 2024

• catch AML error response, add aml script (#869)

  mrwyattii

  authored
  ffb8a4b

  Copy full SHA for ffb8a4b

Commits on Feb 29, 2024

• Extend FastGen benchmark to use AML endpoints (#865)

  Show description for 8182a8b
  

  mrwyattii

  and

  lekurile

  authored
  8182a8b

  Copy full SHA for 8182a8b

Commits on Jan 19, 2024

• Generalize MII benchmark for any model (#851)

  mrwyattii

  authored
  8216f5f

  Copy full SHA for 8216f5f

Commits on Dec 20, 2023

• Improve Comms Benchmark Timing (#833)

  Show description for 8e4cdd8
  Quentin-Anthony

  authored
  8e4cdd8

  Copy full SHA for 8e4cdd8

Commits on Nov 21, 2023

• update MII benchmark to reflect changes in output type (#812)

  mrwyattii

  authored
  b116838

  Copy full SHA for b116838

Commits on Nov 17, 2023

• Adds script as an example of a run of DS-FastGen (#810)

  Show description for 09af71a
  

  PareesaMS

  and

  awan-10

  authored
  09af71a

  Copy full SHA for 09af71a

Commits on Nov 8, 2023

• Add benchmark scripts for DeepSpeed-FastGen (#805)

  Show description for 089baad
  tohtana

  authored
  089baad

  Copy full SHA for 089baad

Commits on Jun 23, 2023

• adds triton-bert-benchmarking script (#440)

  Show description for 1bfda32
  

  stephen-youn

  and

  styoun

  authored
  1bfda32

  Copy full SHA for 1bfda32

Commits on Apr 11, 2023

• fix HF infer & update mpsize arg (#262)

  Show description for 85a69e8
  

  satpalsr

  and

  mrwyattii

  authored
  85a69e8

  Copy full SHA for 85a69e8

Commits on Apr 3, 2023

• Add benchmarks (#254)

  Show description for 2007b52
  

  3 peopleauthored
  2007b52

  Copy full SHA for 2007b52