Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 24, 2024

• [Bugfix] Fix torch dynamo fixes caused by replace_parameters (vllm-project#8748)

  LucasWilkinson

  authored
  72fc97a

  Copy full SHA for 72fc97a

• [Frontend] Batch inference for llm.chat() API (vllm-project#8648)

  Show description for 2529d09
  

  3 peopleauthored
  2529d09

  Copy full SHA for 2529d09

• [Kernel] Split Marlin MoE kernels into multiple files (vllm-project#8661)

  Show description for a928ded
  

  ElizaWszola

  and

  mgoin

  authored
  a928ded

  Copy full SHA for a928ded

• [Bugfix] Fix potentially unsafe custom allreduce synchronization (vllm-project#8558)

  hanzhi713

  authored
  cc4325b

  Copy full SHA for cc4325b

• [Model] Expose Phi3v num_crops as a mm_processor_kwarg (vllm-project#8658)

  Show description for 8ff7ced
  

  alex-jw-brooks

  and

  DarkLight1337

  authored
  8ff7ced

  Copy full SHA for 8ff7ced

• [Core][Model] Support loading weights by ID within models (vllm-project#7931)

  petersalas

  authored
  3f06bae

  Copy full SHA for 3f06bae

• [MISC] Skip dumping inputs when unpicklable (vllm-project#8744)

  comaniac

  authored
  b8747e8

  Copy full SHA for b8747e8

• Revert "[Core] Rename PromptInputs to PromptType, and inputs to prompt" (vllm-project#8750)

  simon-mo

  authored
  3185fb0

  Copy full SHA for 3185fb0

• re-implement beam search on top of vllm core (vllm-project#8726)

  Show description for 0250dd6
  

  youkaichao

  and

  LunrEclipse

  authored
  0250dd6

  Copy full SHA for 0250dd6

• Fix tests in test_scheduler.py that fail with BlockManager V2 (vllm-project#8728)

  sroy745

  authored
  88577ac

  Copy full SHA for 88577ac

• [Hardware][AMD] ROCm6.2 upgrade (vllm-project#8674)

  hongxiayang

  authored
  530821d

  Copy full SHA for 530821d

Commits on Sep 23, 2024

• Add output streaming support to multi-step + async while ensuring RequestOutput obj reuse (vllm-project#8335)

  alexm-redhat

  authored
  1a2aef3

  Copy full SHA for 1a2aef3

• Fix typical acceptance sampler with correct recovered token ids (vllm-project#8562)

  jiqing-feng

  authored
  5f7bb58

  Copy full SHA for 5f7bb58

• [Core] Allow IPv6 in VLLM_HOST_IP with zmq (vllm-project#8575)

  Show description for b05f5c9
  russellb

  authored
  b05f5c9

  Copy full SHA for b05f5c9

• [Kernel][LoRA] Add assertion for punica sgmv kernels (vllm-project#7585)

  jeejeelee

  authored
  9b0e3ec

  Copy full SHA for 9b0e3ec

• [Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (vllm-project#7701)

  Show description for 86e9c8d
  

  4 peopleauthored
  86e9c8d

  Copy full SHA for 86e9c8d

• [CI/Build] use setuptools-scm to set __version__ (vllm-project#4738)

  Show description for ee5f34b
  

  dtrifiro

  and

  youkaichao

  authored
  ee5f34b

  Copy full SHA for ee5f34b

• [VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use config.text_config.vocab_size (vllm-project#8707)

  janimo

  authored
  f2bd246

  Copy full SHA for f2bd246

• [Model] Support pp for qwen2-vl (vllm-project#8696)

  liuyanyi

  authored
  a79e522

  Copy full SHA for a79e522

• [Bugfix][CPU] fix missing input intermediate_tensors in the cpu_model_runner (vllm-project#8733)

  bigPYJ1151

  authored
  3e83c12

  Copy full SHA for 3e83c12

• [Hardware][CPU] Refactor CPU model runner (vllm-project#8729)

  Isotr0py

  authored
  e551ca1

  Copy full SHA for e551ca1

• [Core][Frontend] Support Passing Multimodal Processor Kwargs (vllm-project#8657)

  Show description for 9b8c8ba
  alex-jw-brooks

  authored
  9b8c8ba

  Copy full SHA for 9b8c8ba

• [Bugfix] fix docker build for xpu (vllm-project#8652)

  yma11

  authored
  d23679e

  Copy full SHA for d23679e

• [Bugfix] Fix CPU CMake build (vllm-project#8723)

  Show description for 57a0702
  

  ProExpertProg

  and

  zhouyuan

  authored
  57a0702

  Copy full SHA for 57a0702

• [Bugfix] Avoid some bogus messages RE CUTLASS's revision when building (vllm-project#8702)

  tlrmchlsmth

  authored
  3dda7c2

  Copy full SHA for 3dda7c2

Commits on Sep 22, 2024

• [misc] upgrade mistral-common (vllm-project#8715)

  youkaichao

  authored
  92ba7e7

  Copy full SHA for 92ba7e7

• [build] enable existing pytorch (for GH200, aarch64, nightly) (vllm-project#8713)

  youkaichao

  authored
  d4a2ac8

  Copy full SHA for d4a2ac8

• [SpecDec][Misc] Cleanup, remove bonus token logic. (vllm-project#8701)

  LiuXiaoxuanPKU

  authored
  c6bd70d

  Copy full SHA for c6bd70d

• [Model][VLM] Add LLaVA-Onevision model support (vllm-project#8486)

  Show description for 5b59532
  

  4 peopleauthored
  5b59532

  Copy full SHA for 5b59532

• [MISC] rename CudaMemoryProfiler to DeviceMemoryProfiler (vllm-project#8703)

  ji-huazhong

  authored
  ca2b628

  Copy full SHA for ca2b628

• [Misc] Use NamedTuple in Multi-image example (vllm-project#8705)

  Show description for 8ca5051
  alex-jw-brooks

  authored
  8ca5051

  Copy full SHA for 8ca5051

• [Model] Refactor BLIP/BLIP-2 to support composite model loading (vllm-project#8407)

  DarkLight1337

  authored
  06ed281

  Copy full SHA for 06ed281

• [ci][build] fix vllm-flash-attn (vllm-project#8699)

  youkaichao

  authored
  0e40ac9

  Copy full SHA for 0e40ac9

• [Bugfix] Refactor composite weight loading logic (vllm-project#8656)

  Isotr0py

  authored
  13d88d4

  Copy full SHA for 13d88d4

Commits on Sep 21, 2024

• [Kernel][Bugfix] Delete some more useless code in marlin_moe_ops.cu (vllm-project#8643)

  tlrmchlsmth

  authored
  d66ac62

  Copy full SHA for d66ac62

Pagination

Previous

Next