Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 3, 2024

• [Core][Performance] Add XGrammar support for guided decoding and set it as default (vllm-project#10785)

  Show description for 9323a31
  

  aarnphm

  and

  mgoin

  authored
  9323a31

  Copy full SHA for 9323a31

• [Misc] Remove deprecated names (vllm-project#10817)

  Show description for 3257d44
  DarkLight1337

  authored
  3257d44

  Copy full SHA for 3257d44

• [Doc] Add github links for source code references (vllm-project#10672)

  Show description for ef51831
  

  russellb

  and

  DarkLight1337

  authored
  ef51831

  Copy full SHA for ef51831

• [torch.compile] remove compilation_context and simplify code (vllm-project#10838)

  Show description for dc5ce86
  youkaichao

  authored
  dc5ce86

  Copy full SHA for dc5ce86

• [core][distributed] add pynccl broadcast (vllm-project#10843)

  Show description for 21fe7b4
  youkaichao

  authored
  21fe7b4

  Copy full SHA for 21fe7b4

• [Bugfix] Fix QKVParallelLinearWithShardedLora bias bug (vllm-project#10844)

  Show description for a4cf256
  jeejeelee

  authored
  a4cf256

  Copy full SHA for a4cf256

• [Model] support bitsandbytes quantization with minicpm model (vllm-project#10842)

  Show description for d746268
  zixuanzhang226

  authored
  d746268

  Copy full SHA for d746268

• [Bugfix] Prevent benchmark_throughput.py from using duplicated random prompts (vllm-project#10753)

  mgoin

  authored
  4433195

  Copy full SHA for 4433195

Commits on Dec 2, 2024

• [Model] Add TP and BNB quantization support to LlavaMultiModalProjector (vllm-project#10834)

  Show description for 4c05edb
  

  Isotr0py

  and

  DarkLight1337

  authored
  4c05edb

  Copy full SHA for 4c05edb

• Fix openvino on GPU (vllm-project#10793)

  janimo

  authored
  9b14d97

  Copy full SHA for 9b14d97

• [Misc][XPU] Avoid torch compile for XPU platform (vllm-project#10747)

  Show description for 519cc6c
  

  yma11

  and

  youkaichao

  authored
  519cc6c

  Copy full SHA for 519cc6c

• [Misc][LoRA] Move the implementation of lora bias to punica.py (vllm-project#10829)

  Show description for b45f0d7
  jeejeelee

  authored
  b45f0d7

  Copy full SHA for b45f0d7

• [misc] use out argument for flash attention (vllm-project#10822)

  Show description for a4c4daf
  youkaichao

  authored
  a4c4daf

  Copy full SHA for a4c4daf

• [CI/Build] Update mistral_common version for tests and docs (vllm-project#10825)

  Show description for e95f275
  DarkLight1337

  authored
  e95f275

  Copy full SHA for e95f275

• [Model]: add some tests for aria model (vllm-project#10770)

  Show description for ef31eab
  

  xffxff

  and

  Isotr0py

  authored
  ef31eab

  Copy full SHA for ef31eab

• [doc]Update config docstring (vllm-project#10732)

  Show description for 995a148
  wangxiyuan

  authored
  995a148

  Copy full SHA for 995a148

• [misc] remove xverse modeling file (vllm-project#10814)

  Show description for 63a1641
  youkaichao

  authored
  63a1641

  Copy full SHA for 63a1641

• Fill TorchSDPAAttentionMetadata seq_lens_field for prefill (vllm-project#10799)

  Show description for e25810a
  maxdebayser

  authored
  e25810a

  Copy full SHA for e25810a

• [Kernel] Use out arg in flash_attn_varlen_func (vllm-project#10811)

  Show description for 073a4bd
  WoosukKwon

  authored
  073a4bd

  Copy full SHA for 073a4bd

• [core] Avoid metrics log noise when idle - include speculative decodi… (vllm-project#10809)

  cduk

  authored
  b795477

  Copy full SHA for b795477

• [Model] Add BNB support to Llava and Pixtral-HF (vllm-project#10795)

  Show description for b18c9bb
  Isotr0py

  authored
  b18c9bb

  Copy full SHA for b18c9bb

• [Core] Implement disagg prefill by StatelessProcessGroup (vllm-project#10502)

  Show description for 0590ec3
  KuntaiDu

  authored
  0590ec3

  Copy full SHA for 0590ec3

Commits on Dec 1, 2024

• [Misc] Adding MMMU-Pro vision dataset to serving benchmark (vllm-project#10804)

  Show description for c11f172
  

  3 peopleauthored
  c11f172

  Copy full SHA for c11f172

• [doc] add warning about comparing hf and vllm outputs (vllm-project#10805)

  Show description for 169a0ff
  youkaichao

  authored
  169a0ff

  Copy full SHA for 169a0ff

• [Misc] Rename embedding classes to pooling (vllm-project#10801)

  Show description for d2f058e
  DarkLight1337

  authored
  d2f058e

  Copy full SHA for d2f058e

• [Misc] Improve type annotations for support_torch_compile (vllm-project#10763)

  Show description for f877a7d
  DarkLight1337

  authored
  f877a7d

  Copy full SHA for f877a7d

• [Model] Replace embedding models with pooling adapter (vllm-project#10769)

  Show description for 1337071
  DarkLight1337

  authored
  1337071

  Copy full SHA for 1337071

Commits on Nov 30, 2024

• [doc] format fix (vllm-project#10789)

  Show description for 7e4bbda
  wangxiyuan

  authored
  7e4bbda

  Copy full SHA for 7e4bbda

• [Interleaved ATTN] Support for Mistral-8B (vllm-project#10591)

  Show description for e7cfc4e
  

  patrickvonplaten

  and

  youkaichao

  authored
  e7cfc4e

  Copy full SHA for e7cfc4e

• [Model] Refactor Molmo weights loading to use AutoWeightsLoader (vllm-project#10771)

  Show description for 16ee07f
  Isotr0py

  authored
  16ee07f

  Copy full SHA for 16ee07f

• [Bugfix] Fix OpenVino/Neuron driver_worker init (vllm-project#10779)

  Show description for 40bc242
  

  NickLucche

  and

  DarkLight1337

  authored
  40bc242

  Copy full SHA for 40bc242

Commits on Nov 29, 2024

• [platform] Add verify_quantization in platform. (vllm-project#10757)

  Show description for 661175b
  wangxiyuan

  authored
  661175b

  Copy full SHA for 661175b

• [Bugfix] Fix Idefics3 bug (vllm-project#10778)

  Show description for 3132aac
  jeejeelee

  authored
  3132aac

  Copy full SHA for 3132aac

• [Misc] typo find in sampling_metadata.py (vllm-project#10740)

  noooop

  authored
  c82b432

  Copy full SHA for c82b432

• [Model] Clean up MiniCPMV (vllm-project#10751)

  Show description for fa6ecb9
  DarkLight1337

  authored
  fa6ecb9

  Copy full SHA for fa6ecb9

Pagination

Previous

Next