Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 25, 2024

• [Misc] Make Serving Benchmark More User-friendly (vllm-project#5044)

  ywang96

  authored
  f17a1a8

• [Dynamic Spec Decoding] Minor fix for disabling speculative decoding (vllm-project#5000)

  LiuXiaoxuanPKU

  authored
  d5a1697

• [Misc] add logging level env var (vllm-project#5045)

  youkaichao

  authored
  325c119

• [Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (vllm-project#4799)

  Show description for 8e192ff
  

  4 peopleauthored
  8e192ff

Commits on May 24, 2024

• [Core][Bugfix]: fix prefix caching for blockv2 (vllm-project#4764)

  Show description for e64fde4
  

  leiwen83

  and

  wenlei03

  authored
  e64fde4

• [Bugfix] Fix Mistral v0.3 Weight Loading (vllm-project#5005)

  Show description for 9197709
  

  robertgshaw2-neuralmagic

  and

  comaniac

  authored
  9197709

Commits on May 23, 2024

• [Doc] add ccache guide in doc (vllm-project#5012)

  Show description for 6a50f4c
  

  youkaichao

  and

  mgoin

  authored
  6a50f4c

• [Core]: Option To Use Prompt Token Ids Inside Logits Processor (vllm-project#4985)

  Show description for e3470f8
  kezouke

  authored
  e3470f8

• [Kernel] Initial Activation Quantization Support (vllm-project#4525)

  Show description for a124232
  

  3 peopleauthored
  a124232

• [Core][1/N] Support send/recv in PyNCCL Groups (vllm-project#4988)

  Show description for 5eda2ea
  andoorve

  authored
  5eda2ea

• [Bugfix] Update Dockerfile.cpu to fix NameError: name 'vllm_ops' is not defined (vllm-project#5009)

  LetianLee

  authored
  2ba80be

• Marlin 24 prefill performance improvement (about 25% better on average) (vllm-project#4983)

  alexm-neuralmagic

  authored
  6066253

Commits on May 22, 2024

• [Misc] Take user preference in attention selector (vllm-project#4960)

  comaniac

  authored
  ee3eea0

• [Minor] Fix small typo in llama.py: QKVParallelLinear -> QuantizationConfig (vllm-project#4991)

  pcmoritz

  authored
  a36de68

• [Core] Eliminate parallel worker per-step task scheduling overhead (vllm-project#4894)

  njhill

  authored
  eb6d3c2

• [Model] LoRA gptbigcode implementation (vllm-project#3949)

  raywanb

  authored
  97b0300

• [Misc] Load FP8 kv-cache scaling factors from checkpoints (vllm-project#4893)

  Show description for a3a73ab
  comaniac

  authored
  a3a73ab

• [Kernel] Fixup for CUTLASS kernels in CUDA graphs (vllm-project#4954)

  Show description for 8674f98
  tlrmchlsmth

  authored
  8674f98

• [misc] remove comments that were supposed to be removed (vllm-project#4977)

  rkooo567

  authored
  c74c913

• [CI/Build] Enforce style for C++ and CUDA code with clang-format (vllm-project#4722)

  mgoin

  authored
  5f6d10c

• [Frontend] Dynamic RoPE scaling (vllm-project#4638)

  sasha0552

  authored
  9b9a10d

Commits on May 21, 2024

• [Bugfix][Kernel] Add head size check for attention backend selection (vllm-project#4944)

  Isotr0py

  authored
  99eff67

• [Bugfix] Fix flag name for max_seq_len_to_capture (vllm-project#4935)

  Show description for 14772ee
  kerthcet

  authored
  14772ee

• [CI/Build] Codespell ignore build/ directory (vllm-project#4945)

  mgoin

  authored
  757b62c

• [Docs] Add acknowledgment for sponsors (vllm-project#4925)

  simon-mo

  authored
  e941f88

• [Model] Add Phi-2 LoRA support (vllm-project#4886)

  Isotr0py

  authored
  f12c3b5

• [Model] add rope_scaling support for qwen2 (vllm-project#4930)

  hzhwcmhf

  authored
  d130b57

• [Core] Fix scheduler considering "no LoRA" as "LoRA" (vllm-project#4897)

  Yard1

  authored
  65ae8c2

Commits on May 20, 2024

• [Doc]Add documentation to benchmarking script when running TGI (vllm-project#4920)

  KuntaiDu

  authored
  c3af447

• [Core] Sharded State Loader download from HF (vllm-project#4889)

  aurickq

  authored
  1937e29

• [Bugfix] Fix dummy weight for fp8 (vllm-project#4916)

  Show description for f0eecee
  

  mzusman

  and

  Mor Zusman

  authored
  f0eecee

• [Build/CI] Enabling AMD Entrypoints Test (vllm-project#4834)

  Show description for 943e72c
  

  Alexei-V-Ivanov-AMD

  and

  alexeykondrat

  authored
  943e72c

• [Misc]: allow user to specify port in distributed setting (vllm-project#4914)

  ZwwWayne

  authored
  546a97e

• Remove marlin warning (vllm-project#4918)

  alexm-neuralmagic

  authored
  da5a0b5

• [Model] LLaVA model refactor (vllm-project#4910)

  DarkLight1337

  authored
  6287537

Pagination

PreviousNext