Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 23, 2024

• Marlin 24 prefill performance improvement (about 25% better on average) (vllm-project#4983)

  alexm-redhat

  authored
  6066253

  Copy full SHA for 6066253

Commits on May 22, 2024

• [Misc] Take user preference in attention selector (vllm-project#4960)

  comaniac

  authored
  ee3eea0

  Copy full SHA for ee3eea0

• [Minor] Fix small typo in llama.py: QKVParallelLinear -> QuantizationConfig (vllm-project#4991)

  pcmoritz

  authored
  a36de68

  Copy full SHA for a36de68

• [Core] Eliminate parallel worker per-step task scheduling overhead (vllm-project#4894)

  njhill

  authored
  eb6d3c2

  Copy full SHA for eb6d3c2

• [Model] LoRA gptbigcode implementation (vllm-project#3949)

  raywanb

  authored
  97b0300

  Copy full SHA for 97b0300

• [Misc] Load FP8 kv-cache scaling factors from checkpoints (vllm-project#4893)

  Show description for a3a73ab
  comaniac

  authored
  a3a73ab

  Copy full SHA for a3a73ab

• [Kernel] Fixup for CUTLASS kernels in CUDA graphs (vllm-project#4954)

  Show description for 8674f98
  tlrmchlsmth

  authored
  8674f98

  Copy full SHA for 8674f98

• [misc] remove comments that were supposed to be removed (vllm-project#4977)

  rkooo567

  authored
  c74c913

  Copy full SHA for c74c913

• [CI/Build] Enforce style for C++ and CUDA code with clang-format (vllm-project#4722)

  mgoin

  authored
  5f6d10c

  Copy full SHA for 5f6d10c

• [Frontend] Dynamic RoPE scaling (vllm-project#4638)

  sasha0552

  authored
  9b9a10d

  Copy full SHA for 9b9a10d

Commits on May 21, 2024

• [Bugfix][Kernel] Add head size check for attention backend selection (vllm-project#4944)

  Isotr0py

  authored
  99eff67

  Copy full SHA for 99eff67

• [Bugfix] Fix flag name for max_seq_len_to_capture (vllm-project#4935)

  Show description for 14772ee
  kerthcet

  authored
  14772ee

  Copy full SHA for 14772ee

• [CI/Build] Codespell ignore build/ directory (vllm-project#4945)

  mgoin

  authored
  757b62c

  Copy full SHA for 757b62c

• [Docs] Add acknowledgment for sponsors (vllm-project#4925)

  simon-mo

  authored
  e941f88

  Copy full SHA for e941f88

• [Model] Add Phi-2 LoRA support (vllm-project#4886)

  Isotr0py

  authored
  f12c3b5

  Copy full SHA for f12c3b5

• [Model] add rope_scaling support for qwen2 (vllm-project#4930)

  hzhwcmhf

  authored
  d130b57

  Copy full SHA for d130b57

• [Core] Fix scheduler considering "no LoRA" as "LoRA" (vllm-project#4897)

  Yard1

  authored
  65ae8c2

  Copy full SHA for 65ae8c2

Commits on May 20, 2024

• [Doc]Add documentation to benchmarking script when running TGI (vllm-project#4920)

  KuntaiDu

  authored
  c3af447

  Copy full SHA for c3af447

• [Core] Sharded State Loader download from HF (vllm-project#4889)

  aurickq

  authored
  1937e29

  Copy full SHA for 1937e29

• [Bugfix] Fix dummy weight for fp8 (vllm-project#4916)

  Show description for f0eecee
  

  mzusman

  and

  Mor Zusman

  authored
  f0eecee

  Copy full SHA for f0eecee

• [Build/CI] Enabling AMD Entrypoints Test (vllm-project#4834)

  Show description for 943e72c
  

  Alexei-V-Ivanov-AMD

  and

  alexeykondrat

  authored
  943e72c

  Copy full SHA for 943e72c

• [Misc]: allow user to specify port in distributed setting (vllm-project#4914)

  ZwwWayne

  authored
  546a97e

  Copy full SHA for 546a97e

• Remove marlin warning (vllm-project#4918)

  alexm-redhat

  authored
  da5a0b5

  Copy full SHA for da5a0b5

• [Model] LLaVA model refactor (vllm-project#4910)

  DarkLight1337

  authored
  6287537

  Copy full SHA for 6287537

• [Kernel] Add flash-attn back (vllm-project#4907)

  WoosukKwon

  authored
  b57e6c5

  Copy full SHA for b57e6c5

Commits on May 19, 2024

• [Kernel] Add marlin_24 unit tests (vllm-project#4901)

  alexm-redhat

  authored
  27ce854

  Copy full SHA for 27ce854

• [Bugfix][Model] Add base class for vision-language models (vllm-project#4809)

  DarkLight1337

  authored
  f68470e

  Copy full SHA for f68470e

Commits on May 18, 2024

• [Lora] Support long context lora (vllm-project#4787)

  Show description for 2e9a222
  rkooo567

  authored
  2e9a222

  Copy full SHA for 2e9a222

• [ROCm][Hardware][AMD] Adding Navi21 to fallback to naive attention if Triton is not used (vllm-project#4658)

  alexeykondrat

  authored
  c0724fc

  Copy full SHA for c0724fc

Commits on May 17, 2024

• [Bugfix] Relax tiktoken to >= 0.6.0 (vllm-project#4890)

  mgoin

  authored
  86b45ae

  Copy full SHA for 86b45ae

• [Doc] Update Ray Data distributed offline inference example (vllm-project#4871)

  Yard1

  authored
  c5711ef

  Copy full SHA for c5711ef

• Sync huggingface modifications of qwen Moe model (vllm-project#4774)

  eigen2017

  authored
  48d5985

  Copy full SHA for 48d5985

• [Bugfix] fix rope error when load models with different dtypes (vllm-project#4835)

  jinzhen-lin

  authored
  33e0823

  Copy full SHA for 33e0823

• [Build/CI] Extending the set of AMD tests with Regression, Basic Correctness, Distributed, Engine, Llava Tests (vllm-project#4797)

  Alexei-V-Ivanov-AMD

  authored
  2614812

  Copy full SHA for 2614812

• [Frontend] OpenAI API server: Do not add bos token by default when encoding (vllm-project#4688)

  bofenghuang

  authored
  0150a10

  Copy full SHA for 0150a10

Pagination

Previous

Next