Commits

Branch selector

 7eb4a51

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 9, 2024

• [Core] Support serving encoder/decoder models (vllm-project#7258)

  DarkLight1337

  authored
  7eb4a51

• [TPU] Add Load-time W8A16 quantization for TPU Backend (vllm-project#7005)

  lsy323

  authored
  0fa1490

Commits on Aug 8, 2024

• Add Skywork AI as Sponsor (vllm-project#7314)

  simon-mo

  authored
  5923532

• [Misc] Temporarily resolve the error of BitAndBytes (vllm-project#7308)

  jeejeelee

  authored
  a049b10

• [Bugfix] Fix new Llama3.1 GGUF model loading (vllm-project#7269)

  Isotr0py

  authored
  8334c39

• [CI/Build] Dockerfile.cpu improvements (vllm-project#7298)

  dtrifiro

  authored
  e904576

• [Doc] Put collect_env issue output in a <detail> block (vllm-project#7310)

  mgoin

  authored
  e14fb22

• [Bugfix][fast] Fix the get_num_blocks_touched logic (vllm-project#6849)

  zachzzc

  authored
  782e53a

• [Frontend] Kill the server on engine death (vllm-project#6594)

  Show description for 21b9c49
  joerunde

  authored
  21b9c49

• [Bugfix][Kernel] Increased atol to fix failing tests (vllm-project#7305)

  ProExpertProg

  authored
  5fb4a3f

• [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (vllm-project#7273)

  jeejeelee

  authored
  757ac70

• [Bugfix] Fix LoRA with PP (vllm-project#7292)

  andoorve

  authored
  6dffa4b

• [Frontend] remove max_num_batched_tokens limit for lora (vllm-project#7288)

  NiuBlibing

  authored
  48abee9

• [Misc] Fix typos in scheduler.py (vllm-project#7285)

  Show description for 7467096
  ruisearch42

  authored
  7467096

Commits on Aug 7, 2024

• [Kernel] Fix Flashinfer Correctness (vllm-project#7284)

  LiuXiaoxuanPKU

  authored
  e53dfd3

• [Doc] Update supported_hardware.rst (vllm-project#7276)

  mgoin

  authored
  6d94420

• [FrontEnd] Make merge_async_iterators is_cancelled arg optional (vllm-project#7282)

  njhill

  authored
  fc1493a

• [Bugfix] Fix gptq failure on T4s (vllm-project#7264)

  LucasWilkinson

  authored
  311f743

• [ci] Make building wheels per commit optional (vllm-project#7278)

  Show description for 469b3bc
  khluu

  authored
  469b3bc

• [Bugfix][FP8] Fix dynamic FP8 Marlin quantization (vllm-project#7219)

  mgoin

  authored
  5223199

• [BugFix] Fix frontend multiprocessing hang (vllm-project#7217)

  Show description for fde47d3
  

  maxdebayser

  and

  robertgshaw2-neuralmagic

  authored
  fde47d3

• [Doc] add online speculative decoding example (vllm-project#7243)

  stas00

  authored
  0e12cd6

• [OpenVINO] migrate to latest dependencies versions (vllm-project#7251)

  ilya-lavrenov

  authored
  80cbe10

• [Bugfix] Fix input processor for InternVL2 model (vllm-project#7164)

  Show description for b764547
  

  Isotr0py

  and

  DarkLight1337

  authored
  b764547

• Fixes typo in function name (vllm-project#7275)

  Show description for ab0f5e2
  rafvasq

  authored
  ab0f5e2

• [ BugFix ] Move zmq frontend to IPC instead of TCP (vllm-project#7222)

  robertgshaw2-neuralmagic

  authored
  5649857

• [Misc] Refactor linear layer weight loading; introduce BasevLLMParameter and weight_loader_v2 (vllm-project#5874)

  dsikka

  authored
  0f7052b

• [distributed][misc] add specialized method for cuda platform (vllm-project#7249)

  youkaichao

  authored
  639159b

• [Frontend] Gracefully handle missing chat template and fix CI failure (vllm-project#7238)

  Show description for 66d617e
  

  DarkLight1337

  and

  ywang96

  authored
  66d617e

• [BUGFIX]: top_k is expected to be an integer. (vllm-project#7227)

  Atllkks10

  authored
  7b26109

• [Doc] Mock new dependencies for documentation (vllm-project#7245)

  ywang96

  authored
  2385c8f

• [BugFix] Overhaul async request cancellation (vllm-project#7111)

  njhill

  authored
  9a3f49a

• [Bugfix] Fix GPTQ and GPTQ Marlin CPU Offloading (vllm-project#7225)

  mgoin

  authored
  f9a5600

Commits on Aug 6, 2024

• [Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (vllm-project#4942)

  Show description for fd95e02
  

  3 peopleauthored
  fd95e02

• [Core] Optimize evictor-v2 performance (vllm-project#7193)

  xiaobochen123

  authored
  660470e

Pagination

PreviousNext