Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 30, 2024

• [benchmark] Remove dependency for H100 benchmark step (vllm-project#11572)

  khluu

  authored
  ccb1aab

  Copy full SHA for ccb1aab

• [Bugfix] Validate and concatenate image embeddings in MiniCPMVBaseModel (vllm-project#11631)

  whyiug

  authored
  36e7670

  Copy full SHA for 36e7670

• [V1] [6/N] API Server: Better Shutdown (vllm-project#11586)

  robertgshaw2-redhat

  authored
  5886aa4

  Copy full SHA for 5886aa4

• [VLM] Abstract out multi-modal data parsing in merged processor (vllm-project#11620)

  Show description for 8d9b672
  DarkLight1337

  authored
  8d9b672

  Copy full SHA for 8d9b672

• [platforms] enable platform plugins (vllm-project#11602)

  Show description for b12e87f
  youkaichao

  authored
  b12e87f

  Copy full SHA for b12e87f

• [CI/Build][CPU] Fix CPU CI by lazy importing triton FP8 kernels (vllm-project#11618)

  Show description for 5dbf854
  bigPYJ1151

  authored
  5dbf854

  Copy full SHA for 5dbf854

• [Build][Kernel] Update CUTLASS to v3.6.0 (vllm-project#11607)

  Show description for 970d6d0
  tlrmchlsmth

  authored
  970d6d0

  Copy full SHA for 970d6d0

• [Docker] bump up neuron sdk v2.21 (vllm-project#11593)

  Show description for 628ec6c
  liangfu

  authored
  628ec6c

  Copy full SHA for 628ec6c

• [v1] fix compilation cache (vllm-project#11598)

  Show description for 3682e33
  youkaichao

  authored
  3682e33

  Copy full SHA for 3682e33

Commits on Dec 29, 2024

• Remove print statement in DeepseekScalingRotaryEmbedding (vllm-project#11604)

  mgoin

  authored
  0aa38d1

  Copy full SHA for 0aa38d1

• [Misc] KV cache transfer connector registry (vllm-project#11481)

  Show description for faef77c
  KuntaiDu

  authored
  faef77c

  Copy full SHA for faef77c

• [v1][bugfix] fix cudagraph with inplace buffer assignment (vllm-project#11596)

  Show description for dba4d9d
  youkaichao

  authored
  dba4d9d

  Copy full SHA for dba4d9d

• [Doc] Convert list tables to MyST (vllm-project#11594)

  Show description for 32b4c63
  DarkLight1337

  authored
  32b4c63

  Copy full SHA for 32b4c63

Commits on Dec 28, 2024

• [V1] [5/N] API Server: unify Detokenizer and EngineCore input (vllm-project#11545)

  Show description for 4fb8e32
  robertgshaw2-redhat

  authored
  4fb8e32

  Copy full SHA for 4fb8e32

• [bugfix] interleaving sliding window for cohere2 model (vllm-project#11583)

  Show description for 328841d
  youkaichao

  authored
  328841d

  Copy full SHA for 328841d

• [Doc] Minor documentation fixes (vllm-project#11580)

  Show description for d427e5c
  DarkLight1337

  authored
  d427e5c

  Copy full SHA for d427e5c

• [V1][Minor] Set pin_memory=False for token_ids_cpu tensor (vllm-project#11581)

  Show description for 42bb201
  WoosukKwon

  authored
  42bb201

  Copy full SHA for 42bb201

• [Hardware][AMD]: Replace HIPCC version with more precise ROCm version (vllm-project#11515)

  Show description for 59d6bb4
  hj-wei

  authored
  59d6bb4

  Copy full SHA for 59d6bb4

• [Model] Remove hardcoded image tokens ids from Pixtral (vllm-project#11582)

  Show description for b7dcc00
  ywang96

  authored
  b7dcc00

  Copy full SHA for b7dcc00

• [Model] Support InternLM2 Reward models (vllm-project#11571)

  Show description for d34be24
  

  Isotr0py

  and

  DarkLight1337

  authored
  d34be24

  Copy full SHA for d34be24

• [Bugfix] Last token measurement fix (vllm-project#11376)

  Show description for b5cbe8e
  

  rajveerb

  and

  ywang96

  authored
  b5cbe8e

  Copy full SHA for b5cbe8e

• [V1] [4/N] API Server: ZMQ/MP Utilities (vllm-project#11541)

  robertgshaw2-redhat

  authored
  df04dff

  Copy full SHA for df04dff

• [Doc] Update mllama example based on official doc (vllm-project#11567)

  Show description for a607312
  heheda12345

  authored
  a607312

  Copy full SHA for a607312

Commits on Dec 27, 2024

• [Bugfix] Fix for ROCM compressed tensor support (vllm-project#11561)

  selalipop

  authored
  ac79799

  Copy full SHA for ac79799

• [Misc] Improve BNB loader to handle mixture of sharded and merged weights with same suffix (vllm-project#11566)

  Show description for dde1fa1
  Isotr0py

  authored
  dde1fa1

  Copy full SHA for dde1fa1

• [Misc]Add BNB quantization for MolmoForCausalLM (vllm-project#11551)

  Show description for 0240402
  jeejeelee

  authored
  0240402

  Copy full SHA for 0240402

• [MODEL] LoRA support for Jamba model (vllm-project#11209)

  Show description for 55509c2
  ErezSC42

  authored
  55509c2

  Copy full SHA for 55509c2

• [VLM] Support caching in merged multi-modal processor (vllm-project#11396)

  Show description for 1014180
  DarkLight1337

  authored
  1014180

  Copy full SHA for 1014180

• [Doc] Add xgrammar in doc (vllm-project#11549)

  Show description for 5ce4627
  Chen-0210

  authored
  5ce4627

  Copy full SHA for 5ce4627

• [Misc] Abstract the logic for reading and writing media content (vllm-project#11527)

  Show description for 7af553e
  DarkLight1337

  authored
  7af553e

  Copy full SHA for 7af553e

• [Bugfix] Fix TeleChat2ForCausalLM weights mapper (vllm-project#11546)

  Show description for 2c9b8ea
  jeejeelee

  authored
  2c9b8ea

  Copy full SHA for 2c9b8ea

• Update deploying_with_k8s.md with AMD ROCm GPU example (vllm-project#11465)

  Show description for d003f3e
  

  AlexHe99

  and

  DarkLight1337

  authored
  d003f3e

  Copy full SHA for d003f3e

• [Platform] Move model arch check to platform (vllm-project#11503)

  Show description for 6c6f7fe
  MengqingCao

  authored
  6c6f7fe

  Copy full SHA for 6c6f7fe

• [BugFix] Fix quantization for all other methods (vllm-project#11547)

  robertgshaw2-redhat

  authored
  2339d59

  Copy full SHA for 2339d59

• [V1][3/N] API Server: Reduce Task Switching + Handle Abort Properly (vllm-project#11534)

  robertgshaw2-redhat

  authored
  1b875a0

  Copy full SHA for 1b875a0

Pagination

Previous

Next