Commits

Branch selector

 1c445dc

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 24, 2024

• [CI/Build] Print running script to enhance CI log readability (vllm-project#10594)

  Show description for 1c445dc
  jeejeelee

  authored
  1c445dc

  Copy full SHA for 1c445dc

• [Bugfix] Fix LoRA weight sharding (vllm-project#10450)

  Show description for 1700c54
  

  jeejeelee

  and

  DarkLight1337

  authored
  1700c54

  Copy full SHA for 1700c54

• [bugfix] Fix example/tensorize_vllm_model tests (vllm-project#10595)

  Show description for 17d8fc1
  jeejeelee

  authored
  17d8fc1

  Copy full SHA for 17d8fc1

Commits on Nov 23, 2024

• [Bugfix] Avoid import AttentionMetadata explicitly in Mllama (vllm-project#10593)

  Show description for 04668eb
  Isotr0py

  authored
  04668eb

  Copy full SHA for 04668eb

• For ppc64le, disabled tests for now and addressed space issues (vllm-project#10538)

  npanpaliya

  authored
  651f6c3

  Copy full SHA for 651f6c3

• [Platforms] Refactor openvino code (vllm-project#10573)

  Show description for 86a44fb
  ji-huazhong

  authored
  86a44fb

  Copy full SHA for 86a44fb

• [Bugfix] multi_modal_kwargs broadcast for CPU tensor parallel (vllm-project#10541)

  Show description for 4cfe5d2
  Isotr0py

  authored
  4cfe5d2

  Copy full SHA for 4cfe5d2

• [2/N] handling placeholders in merged multi-modal processor (vllm-project#10485)

  Show description for c8acd80
  DarkLight1337

  authored
  c8acd80

  Copy full SHA for c8acd80

• Prefix Cache Aware Scheduling [1/n] (vllm-project#10128)

  Show description for 4634a89
  rickyyx

  authored
  4634a89

  Copy full SHA for 4634a89

• [AMD] Add support for GGUF quantization on ROCm (vllm-project#10254)

  kliuae

  authored
  7c25fe4

  Copy full SHA for 7c25fe4

• Update default max_num_batch_tokens for chunked prefill to 2048 (vllm-project#10544)

  mgoin

  authored
  02a43f8

  Copy full SHA for 02a43f8

• [Model] Fix Baichuan BNB online quantization (vllm-project#10572)

  Show description for cfea9c0
  CNTRYROA

  authored
  cfea9c0

  Copy full SHA for cfea9c0

• [Bugfix] Internal Server Error when tool_choice is incorrect. (vllm-project#10567)

  Show description for 7d8ffb3
  shenoyvvarun

  authored
  7d8ffb3

  Copy full SHA for 7d8ffb3

• [core] gemma2 full context length support (vllm-project#10584)

  Show description for 4aba6e3
  youkaichao

  authored
  4aba6e3

  Copy full SHA for 4aba6e3

• [Misc] Add pynccl wrappers for all_gather and reduce_scatter (vllm-project#9432)

  tlrmchlsmth

  authored
  978b397

  Copy full SHA for 978b397

• [Core] Fix broken log configuration (vllm-project#10458)

  Show description for ebda519
  russellb

  authored
  ebda519

  Copy full SHA for ebda519

• [Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (vllm-project#10164)

  Show description for 9195dbd
  tjohnson31415

  authored
  9195dbd

  Copy full SHA for 9195dbd

• [bugfix] fix cpu tests (vllm-project#10585)

  Show description for d559979
  youkaichao

  authored
  d559979

  Copy full SHA for d559979

• [V1] EngineCore supports profiling (vllm-project#10564)

  Show description for d345f40
  Abatom

  authored
  d345f40

  Copy full SHA for d345f40

• [Core] remove temporary local variables in LLMEngine.__init__ (vllm-project#10577)

  Show description for 28598f3
  russellb

  authored
  28598f3

  Copy full SHA for 28598f3

• support bitsandbytes quantization with qwen model (vllm-project#10549)

  Show description for 948c859
  zixuanzhang226

  authored
  948c859

  Copy full SHA for 948c859

Commits on Nov 22, 2024

• [v1] Refactor KVCacheManager for more hash input than token ids (vllm-project#10507)

  Show description for 97814fb
  

  rickyyx

  and

  comaniac

  authored
  97814fb

  Copy full SHA for 97814fb

• [torch.compile] support all attention backends (vllm-project#10558)

  Show description for eebad39
  youkaichao

  authored
  eebad39

  Copy full SHA for eebad39

• [bugfix] fix full graph tests (vllm-project#10581)

  Show description for db100c5
  youkaichao

  authored
  db100c5

  Copy full SHA for db100c5

• Remove token-adding chat embedding params (vllm-project#10551)

  Show description for 11fcf0e
  noamgat

  authored
  11fcf0e

  Copy full SHA for 11fcf0e

• [Bugfix] Fix Phi-3 BNB quantization with tensor parallel (vllm-project#9948)

  Show description for b6374e0
  Isotr0py

  authored
  b6374e0

  Copy full SHA for b6374e0

• [platforms] absorb worker cls difference into platforms folder (vllm-project#10555)

  Show description for a111d01
  

  youkaichao

  and

  njhill

  authored
  a111d01

  Copy full SHA for a111d01

• [Minor] Fix line-too-long (vllm-project#10563)

  Show description for 446c780
  WoosukKwon

  authored
  446c780

  Copy full SHA for 446c780

• [9/N] torch.compile LLM usage (vllm-project#10552)

  Show description for 33e0a25
  youkaichao

  authored
  33e0a25

  Copy full SHA for 33e0a25

• [Benchmark] Add new H100 machine (vllm-project#10547)

  simon-mo

  authored
  aed0748

  Copy full SHA for aed0748

Commits on Nov 21, 2024

• Add small example to metrics.rst (vllm-project#10550)

  mgoin

  authored
  9afa014

  Copy full SHA for 9afa014

• [Minor] Revert change in offline inference example (vllm-project#10545)

  Show description for 46fe9b4
  WoosukKwon

  authored
  46fe9b4

  Copy full SHA for 46fe9b4

• [misc] improve error message (vllm-project#10553)

  Show description for cf656f5
  youkaichao

  authored
  cf656f5

  Copy full SHA for cf656f5

• [CI][Installation] Avoid uploading CUDA 11.8 wheel (vllm-project#10535)

  Show description for edec338
  

  cermeng

  and

  simon-mo

  authored
  edec338

  Copy full SHA for edec338

• [V1] Fix Compilation config & Enable CUDA graph by default (vllm-project#10528)

  Show description for f9310cb
  WoosukKwon

  authored
  f9310cb

  Copy full SHA for f9310cb

Pagination

Previous

Next