Commits

Branch selector

 refs/heads/varun/multi-step-pp-bugfix

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 28, 2024

• codespell ignore

  

  Varun Sundar Rabindranath

  committed
  b5f58c5

• fix prompt in test

  

  Varun Sundar Rabindranath

  committed
  2b0fc15

Commits on Sep 27, 2024

• Bugfix : Multi-step + PP

  

  Varun Sundar Rabindranath

  committed
  1b925bb

• [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (vllm-project#8378)

  Show description for c2ec430
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  c2ec430

• [Bugfix] fix for deepseek w4a16 (vllm-project#8906)

  Show description for c5d5535
  

  LucasWilkinson

  and

  mgoin

  authored
  c5d5535

• [Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear method (vllm-project#7271)

  ProExpertProg

  authored
  172d1cd

• [torch.compile] use empty tensor instead of None for profiling (vllm-project#8875)

  youkaichao

  authored
  a9b15c6

• [TPU] Update pallas.py to support trillium (vllm-project#8871)

  bvrockwell

  authored
  8df2dc3

• [Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm-project#8892)

  Isotr0py

  authored
  6d792d2

• [MISC] Fix invalid escape sequence '\' (vllm-project#8830)

  Show description for 0e08875
  panpan0000

  authored
  0e08875

• [misc] fix collect env (vllm-project#8894)

  youkaichao

  authored
  dc4e3df

• [Core] renamePromptInputs and inputs (vllm-project#8876)

  DarkLight1337

  authored
  3b00b9c

• [Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)

  Show description for 344cd2b
  maxdebayser

  authored
  344cd2b

Commits on Sep 26, 2024

• [Installation] Allow lower versions of FastAPI to maintain Ray 2.9 compatibility (vllm-project#8764)

  DarkLight1337

  authored
  1b49148

• [BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-project#8829)

  njhill

  authored
  4b377d6

• [Bugfix] Fixup advance_step.cu warning (vllm-project#8815)

  tlrmchlsmth

  authored
  71d21c7

• fix validation: Only set tool_choice auto if at least one tool is provided (vllm-project#8568)

  chiragjn

  authored
  ee2da3e

• [Bugfix] Fix print_warning_once's line info (vllm-project#8867)

  tlrmchlsmth

  authored
  e2f6f26

• [Misc] Change dummy profiling and BOS fallback warns to log once (vllm-project#8820)

  mgoin

  authored
  b28d210

• [Bugfix] Include encoder prompts len to non-stream api usage response (vllm-project#8861)

  Pernekhan

  authored
  93d364d

• [ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-project#8872)

  Show description for d9cfbc8
  khluu

  authored
  d9cfbc8

• [misc][installation] build from source without compilation (vllm-project#8818)

  youkaichao

  authored
  70de39f

• [CI/Build] Fix missing ci dependencies (vllm-project#8834)

  fyuan1316

  authored
  68988d4

• [Docs] Add README to the build docker image (vllm-project#8825)

  mgoin

  authored
  520db4d

• [Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-project#8814)

  tlrmchlsmth

  authored
  f70bcca

• [Misc] Update config loading for Qwen2-VL and remove Granite (vllm-project#8837)

  ywang96

  authored
  4bb98f2

Commits on Sep 25, 2024

• [Misc] Support quantization of MllamaForCausalLM (vllm-project#8822)

  mgoin

  authored
  7193774

• [Doc] Update doc for Transformers 4.45 (vllm-project#8817)

  ywang96

  authored
  e2c6e0a

• [Model] Add support for the multi-modal Llama 3.2 model (vllm-project#8811)

  Show description for 770ec60
  

  4 peopleauthored
  770ec60

• Revert "rename PromptInputs and inputs with backward compatibility (vllm-project#8760) (vllm-project#8810)

  simon-mo

  authored
  4f1ba08

• [Misc] Support FP8 MoE for compressed-tensors (vllm-project#8588)

  mgoin

  authored
  873edda

• [Frontend] MQLLMEngine supports profiling. (vllm-project#8761)

  Abatom

  authored
  64840df

• rename PromptInputs and inputs with backward compatibility (vllm-project#8760)

  DarkLight1337

  authored
  28e1299

• [VLM][Bugfix] internvl with num_scheduler_steps > 1 (vllm-project#8614)

  DefTruth

  authored
  0c4d2ad

• [[Misc]] Add extra deps for openai server image (vllm-project#8792)

  jeejeelee

  authored
  c6f2485

Pagination

PreviousNext