Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 2, 2024

• [misc] use out argument for flash attention (vllm-project#10822)

  Show description for a4c4daf
  youkaichao

  authored
  a4c4daf

  Copy full SHA for a4c4daf

• [CI/Build] Update mistral_common version for tests and docs (vllm-project#10825)

  Show description for e95f275
  DarkLight1337

  authored
  e95f275

  Copy full SHA for e95f275

• [Model]: add some tests for aria model (vllm-project#10770)

  Show description for ef31eab
  

  xffxff

  and

  Isotr0py

  authored
  ef31eab

  Copy full SHA for ef31eab

• [doc]Update config docstring (vllm-project#10732)

  Show description for 995a148
  wangxiyuan

  authored
  995a148

  Copy full SHA for 995a148

• [misc] remove xverse modeling file (vllm-project#10814)

  Show description for 63a1641
  youkaichao

  authored
  63a1641

  Copy full SHA for 63a1641

• Fill TorchSDPAAttentionMetadata seq_lens_field for prefill (vllm-project#10799)

  Show description for e25810a
  maxdebayser

  authored
  e25810a

  Copy full SHA for e25810a

• [Kernel] Use out arg in flash_attn_varlen_func (vllm-project#10811)

  Show description for 073a4bd
  WoosukKwon

  authored
  073a4bd

  Copy full SHA for 073a4bd

• [core] Avoid metrics log noise when idle - include speculative decodi… (vllm-project#10809)

  cduk

  authored
  b795477

  Copy full SHA for b795477

• [Model] Add BNB support to Llava and Pixtral-HF (vllm-project#10795)

  Show description for b18c9bb
  Isotr0py

  authored
  b18c9bb

  Copy full SHA for b18c9bb

• [Core] Implement disagg prefill by StatelessProcessGroup (vllm-project#10502)

  Show description for 0590ec3
  KuntaiDu

  authored
  0590ec3

  Copy full SHA for 0590ec3

Commits on Dec 1, 2024

• [Misc] Adding MMMU-Pro vision dataset to serving benchmark (vllm-project#10804)

  Show description for c11f172
  

  3 peopleauthored
  c11f172

  Copy full SHA for c11f172

• [doc] add warning about comparing hf and vllm outputs (vllm-project#10805)

  Show description for 169a0ff
  youkaichao

  authored
  169a0ff

  Copy full SHA for 169a0ff

• [Misc] Rename embedding classes to pooling (vllm-project#10801)

  Show description for d2f058e
  DarkLight1337

  authored
  d2f058e

  Copy full SHA for d2f058e

• [Misc] Improve type annotations for support_torch_compile (vllm-project#10763)

  Show description for f877a7d
  DarkLight1337

  authored
  f877a7d

  Copy full SHA for f877a7d

• [Model] Replace embedding models with pooling adapter (vllm-project#10769)

  Show description for 1337071
  DarkLight1337

  authored
  1337071

  Copy full SHA for 1337071

Commits on Nov 30, 2024

• [doc] format fix (vllm-project#10789)

  Show description for 7e4bbda
  wangxiyuan

  authored
  7e4bbda

  Copy full SHA for 7e4bbda

• [Interleaved ATTN] Support for Mistral-8B (vllm-project#10591)

  Show description for e7cfc4e
  

  patrickvonplaten

  and

  youkaichao

  authored
  e7cfc4e

  Copy full SHA for e7cfc4e

• [Model] Refactor Molmo weights loading to use AutoWeightsLoader (vllm-project#10771)

  Show description for 16ee07f
  Isotr0py

  authored
  16ee07f

  Copy full SHA for 16ee07f

• [Bugfix] Fix OpenVino/Neuron driver_worker init (vllm-project#10779)

  Show description for 40bc242
  

  NickLucche

  and

  DarkLight1337

  authored
  40bc242

  Copy full SHA for 40bc242

Commits on Nov 29, 2024

• [platform] Add verify_quantization in platform. (vllm-project#10757)

  Show description for 661175b
  wangxiyuan

  authored
  661175b

  Copy full SHA for 661175b

• [Bugfix] Fix Idefics3 bug (vllm-project#10778)

  Show description for 3132aac
  jeejeelee

  authored
  3132aac

  Copy full SHA for 3132aac

• [Misc] typo find in sampling_metadata.py (vllm-project#10740)

  noooop

  authored
  c82b432

  Copy full SHA for c82b432

• [Model] Clean up MiniCPMV (vllm-project#10751)

  Show description for fa6ecb9
  DarkLight1337

  authored
  fa6ecb9

  Copy full SHA for fa6ecb9

Commits on Nov 28, 2024

• [Model] Add Internlm2 LoRA support (vllm-project#5064)

  Show description for c83919c
  Isotr0py

  authored
  c83919c

  Copy full SHA for c83919c

• [V1] Optimize the CPU overheads in FlashAttention custom op (vllm-project#10733)

  Show description for 98f47f2
  WoosukKwon

  authored
  98f47f2

  Copy full SHA for 98f47f2

• [Kernel] Update vllm-flash-attn version to reduce CPU overheads (vllm-project#10742)

  Show description for 8c1e77f
  WoosukKwon

  authored
  8c1e77f

  Copy full SHA for 8c1e77f

• [Model] Added GLM-4 series hf format model support vllm==0.6.4 (vllm-project#10561)

  Show description for 5fc5ce0
  

  3 peopleauthored
  5fc5ce0

  Copy full SHA for 5fc5ce0

• [TPU] Update requirements-tpu (vllm-project#10726)

  Show description for 3ed5e73
  richardsliu

  authored
  3ed5e73

  Copy full SHA for 3ed5e73

• [Kernel] Update vllm-flash-attn version (vllm-project#10736)

  Show description for 9a8bff0
  WoosukKwon

  authored
  9a8bff0

  Copy full SHA for 9a8bff0

• [V1] Do not allocate beyond the max_model_len (vllm-project#10730)

  Show description for a79b122
  WoosukKwon

  authored
  a79b122

  Copy full SHA for a79b122

• [Bug][CLI] Allow users to disable prefix caching explicitly (vllm-project#10724)

  Show description for d9b4b3f
  rickyyx

  authored
  d9b4b3f

  Copy full SHA for d9b4b3f

• [Doc] Update model in arch_overview.rst to match comment (vllm-project#10701)

  Show description for 278be67
  spacewander

  authored
  278be67

  Copy full SHA for 278be67

• [Model] support bitsandbytes quantization with minicpm3 model (vllm-project#10682)

  Show description for 70dc14f
  zixuanzhang226

  authored
  70dc14f

  Copy full SHA for 70dc14f

• [misc] upgrade filelock version (vllm-project#10731)

  Show description for cb4e1c3
  youkaichao

  authored
  cb4e1c3

  Copy full SHA for cb4e1c3

Commits on Nov 27, 2024

• [Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (vllm-project#10635)

  Show description for 395b1c7
  tomeras91

  authored
  395b1c7

  Copy full SHA for 395b1c7

Pagination

Previous

Next