Commits

Breadcrumbs

History for

on8a25d3a

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 17, 2023

• Optimize model execution with CUDA graph (vllm-project#1926)

  Show description for 37ca558
  

  3 peopleauthored
  37ca558

Commits on Dec 15, 2023

• Add GPTQ support (vllm-project#916)

  chu-tianxiang

  authored
  0fbfc4b

Commits on Dec 11, 2023

• Fix latency benchmark script (vllm-project#2035)

  WoosukKwon

  authored
  5dd80d3

Commits on Dec 10, 2023

• Replace head_mapping params with num_kv_heads to attention kernel. (vllm-project#1997)

  Show description for dacaf5a
  

  3 peopleauthored
  dacaf5a

Commits on Dec 6, 2023

• Save pytorch profiler output for latency benchmark (vllm-project#1871)

  Show description for 05ff90b
  Yard1

  authored
  05ff90b

Commits on Nov 30, 2023

• Support max-model-len argument for throughput benchmark (vllm-project#1858)

  aisensiy

  authored
  8d8c2f6

• Remove max_num_seqs in latency benchmark script (vllm-project#1855)

  WoosukKwon

  authored
  51d3cb9

• Add profile option to latency benchmark script (vllm-project#1839)

  WoosukKwon

  authored
  e74b173

Commits on Nov 24, 2023

• [Build] Avoid building too many extensions (vllm-project#1624)

  ymwangg

  authored
  e0c6f55

Commits on Nov 20, 2023

• Migrate linter from pylint to ruff (vllm-project#1665)

  simon-mo

  authored
  5ffc0d1

Commits on Nov 17, 2023

• [Minor] Fix comment (vllm-project#1704)

  linotfan

  authored
  dcc543a

Commits on Nov 14, 2023

• Add DeepSpeed MII backend to benchmark script (vllm-project#1649)

  WoosukKwon

  authored
  660a7fc

Commits on Oct 22, 2023

• Support SqueezeLLM (vllm-project#1326)

  Show description for 1f24755
  

  3 peopleauthored
  1f24755

Commits on Oct 16, 2023

• Implement PagedAttention V2 (vllm-project#1348)

  WoosukKwon

  authored
  928de46

Commits on Oct 3, 2023

• Use monotonic time where appropriate (vllm-project#1249)

  Yard1

  authored
  acbed3e

Commits on Oct 1, 2023

• Added dtype arg to benchmarks (vllm-project#1228)

  kg6-sleipnir

  authored
  b5a10eb

Commits on Sep 16, 2023

• Implement AWQ quantization support for LLaMA (vllm-project#1032)

  Show description for e3e79e9
  

  5 peopleauthored
  e3e79e9

Commits on Jul 20, 2023

• fix: enable trust-remote-code in api server & benchmark. (vllm-project#509)

  gesanqiu

  authored
  8c4b259

• support trust_remote_code in benchmark (vllm-project#518)

  wangruohui

  authored
  cf21a9b

Commits on Jun 28, 2023

• [Tokenizer] Add an option to specify tokenizer (vllm-project#284)

  WoosukKwon

  authored
  4338cc4

Commits on Jun 26, 2023

• [Fix] Fix default port number in benchmark scripts (vllm-project#265)

  zhuohan123

  authored
  43710e8

Commits on Jun 19, 2023

• Remove benchmark_async_llm_server.py (vllm-project#155)

  zhuohan123

  authored
  0370afa

Commits on Jun 18, 2023

• Add comments on swap space (vllm-project#154)

  WoosukKwon

  authored
  3f92038

Commits on Jun 17, 2023

• Change the name to vLLM (vllm-project#150)

  WoosukKwon

  authored
  0b98ba1

• Rename servers to engines (vllm-project#152)

  zhuohan123

  authored
  e5464ee

• [Minor] Fix benchmark_throughput.py (vllm-project#151)

  WoosukKwon

  authored
  bab8f3d

Commits on Jun 16, 2023

• Rename servers and change port numbers to reduce confusion (vllm-project#149)

  zhuohan123

  authored
  eedb46b

Commits on Jun 15, 2023

• Add script for benchmarking serving throughput (vllm-project#145)

  WoosukKwon

  authored
  311490a

Commits on Jun 5, 2023

• Fix various issues of async servers (vllm-project#135)

  zhuohan123

  authored
  1a956e1

Commits on Jun 4, 2023

• Add docstrings for LLM (vllm-project#137)

  WoosukKwon

  authored
  8274ca2

Commits on May 28, 2023

• Add throughput benchmarking script (vllm-project#133)

  WoosukKwon

  authored
  211318d

Loading