Commits

Branch selector

 5d98d56

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 31, 2025

• [Doc] Improve installation signposting (vllm-project#12575)

  Show description for 60808bd
  hmellor

  authored
  60808bd

  Copy full SHA for 60808bd

• [Feature] Fix guided decoding blocking bitmask memcpy (vllm-project#12563)

  Show description for fc54214
  xpbowler

  authored
  fc54214

  Copy full SHA for fc54214

• [Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (vllm-project#12587)

  Show description for eb5741a
  tlrmchlsmth

  authored
  eb5741a

  Copy full SHA for eb5741a

• [Bugfix] Revert MoE Triton Config Default (vllm-project#12629)

  Show description for 145c2ff
  robertgshaw2-redhat

  authored
  145c2ff

  Copy full SHA for 145c2ff

• [release] Add input step to ask for Release version (vllm-project#12631)

  Show description for 415f194
  khluu

  authored
  415f194

  Copy full SHA for 415f194

• [v1][Bugfix] Add extra_keys to block_hash for prefix caching (vllm-project#12603)

  Show description for 89003c4
  heheda12345

  authored
  89003c4

  Copy full SHA for 89003c4

• [Docs][V1] Prefix caching design (vllm-project#12598)

  Show description for 60bcef0
  comaniac

  authored
  60bcef0

  Copy full SHA for 60bcef0

• [Git] Automatically sign-off commits (vllm-project#12595)

  Show description for 847f883
  comaniac

  authored
  847f883

  Copy full SHA for 847f883

• [BugFix] Fix Torch.Compile For DeepSeek (vllm-project#12594)

  Show description for 325f679
  

  robertgshaw2-redhat

  and

  simon-mo

  authored
  325f679

  Copy full SHA for 325f679

• Add favicon to docs (vllm-project#12611)

  Show description for e3f7ff6
  hmellor

  authored
  e3f7ff6

  Copy full SHA for e3f7ff6

• [Bugfix] Gracefully handle huggingface hub http error (vllm-project#12571)

  ywang96

  authored
  7a8987d

  Copy full SHA for 7a8987d

• [Attention] MLA decode optimizations (vllm-project#12528)

  Show description for cabaf4e
  

  7 peopleauthored
  cabaf4e

  Copy full SHA for cabaf4e

• [ROCm][AMD][Model] llama 3.2 support upstreaming (vllm-project#12421)

  Show description for a1fc18c
  

  maleksan85

  and

  Aleksandr Malyshev

  authored
  a1fc18c

  Copy full SHA for a1fc18c

• [Kernel] Update cutlass_scaled_mm to support 2d group (blockwise) scaling (vllm-project#11868)

  LucasWilkinson

  authored
  9798b2f

  Copy full SHA for 9798b2f

Commits on Jan 30, 2025

• [V1][Log] Add max request concurrency log to V1 (vllm-project#12569)

  Show description for 4078052
  mgoin

  authored
  4078052

  Copy full SHA for 4078052

• [CPU][PPC] Updated torch, torchvision, torchaudio dependencies (vllm-project#12555)

  Show description for bd2107e
  npanpaliya

  authored
  bd2107e

  Copy full SHA for bd2107e

• [Kernel] Triton Configs for Fp8 Block Quantization (vllm-project#11589)

  Show description for 9b0c4ba
  

  3 peopleauthored
  9b0c4ba

  Copy full SHA for 9b0c4ba

• [Misc] fix typo: add missing space in lora adapter error message (vllm-project#12564)

  Show description for 41bf561
  Beim

  authored
  41bf561

  Copy full SHA for 41bf561

• Set ?device={device} when changing tab in installation guides (vllm-project#12560)

  Show description for a276903
  hmellor

  authored
  a276903

  Copy full SHA for a276903

• [V1][Metrics] Add GPU cache usage % gauge (vllm-project#12561)

  Show description for f17f1d4
  markmc

  authored
  f17f1d4

  Copy full SHA for f17f1d4

• [Misc][MoE] add Deepseek-V3 moe tuning support (vllm-project#12558)

  Show description for 1c1bb0b
  divakar-amd

  authored
  1c1bb0b

  Copy full SHA for 1c1bb0b

Commits on Jan 29, 2025

• [V1][BugFix] Free encoder cache for aborted requests (vllm-project#12545)

  Show description for e0cc5f2
  WoosukKwon

  authored
  e0cc5f2

  Copy full SHA for e0cc5f2

• Revert "[Build/CI] Fix libcuda.so linkage" (vllm-project#12552)

  tlrmchlsmth

  authored
  73aa6cf

  Copy full SHA for 73aa6cf

• [Kernel] add triton fused moe kernel for gptq/awq (vllm-project#12185)

  jinzhen-lin

  authored
  27b78c7

  Copy full SHA for 27b78c7

• [Hardware][NV] Fix Modelopt model loading for k-v-scales for Llama models. (vllm-project#11787)

  Show description for b02fd28
  

  pavanimajety

  and

  mgoin

  authored
  b02fd28

  Copy full SHA for b02fd28

• [Frontend] Support override generation config in args (vllm-project#12409)

  Show description for ff7424f
  liuyanyi

  authored
  ff7424f

  Copy full SHA for ff7424f

• [Model] Refactoring of MiniCPM-V and add MiniCPM-o-2.6 support for vLLM (vllm-project#12069)

  Show description for d93bf4d
  

  35 peopleauthored
  d93bf4d

  Copy full SHA for d93bf4d

• [Bugfix] handle alignment of arguments in convert_sparse_cross_attention_mask_to_dense (vllm-project#12347)

  Show description for 036ca94
  

  tjohnson31415

  and

  wallashss

  authored
  036ca94

  Copy full SHA for 036ca94

• Fix the pydantic logging validator (vllm-project#12420)

  Show description for ef001d9
  maxdebayser

  authored
  ef001d9

  Copy full SHA for ef001d9

• [V1] Improve Error Message for Unsupported Config (vllm-project#12535)

  Show description for 5f671cb
  

  robertgshaw2-redhat

  and

  mgoin

  authored
  5f671cb

  Copy full SHA for 5f671cb

• Bugfix for whisper quantization due to fake k_proj bias (vllm-project#12524)

  Show description for bd02164
  mgoin

  authored
  bd02164

  Copy full SHA for bd02164

• [V1][Metrics] Add TTFT and TPOT histograms (vllm-project#12530)

  Show description for 46fb056
  markmc

  authored
  46fb056

  Copy full SHA for 46fb056

• [Doc] Convert docs to use colon fences (vllm-project#12471)

  Show description for dd6a3a0
  hmellor

  authored
  dd6a3a0

  Copy full SHA for dd6a3a0

• [Frontend] Support reasoning content for deepseek r1 (vllm-project#12473)

  Show description for a7e3eba
  

  4 peopleauthored
  a7e3eba

  Copy full SHA for a7e3eba

• [TPU] Add example for profiling TPU inference (vllm-project#12531)

  Show description for fbb5bd4
  mgoin

  authored
  fbb5bd4

  Copy full SHA for fbb5bd4

Pagination

Previous

Next