Commits

Branch selector

 89579a2

User selector

All users

All time

Commit History

Commits on May 8, 2024

• [Misc] Use vllm-flash-attn instead of flash-attn (vllm-project#4686)

  WoosukKwon

  authored
  89579a2

  Copy full SHA for 89579a2

• [CI/Test] fix swap test for multi gpu (vllm-project#4689)

  youkaichao

  authored
  230c4b3

  Copy full SHA for 230c4b3

• [Core][Optimization] change python dict to pytorch tensor for blocks to swap (vllm-project#4659)

  youkaichao

  authored
  20cfcde

  Copy full SHA for 20cfcde

• [Core] Faster startup for LoRA enabled models (vllm-project#4634)

  Yard1

  authored
  ad932a2

  Copy full SHA for ad932a2

• [Misc] Add get_name method to attention backends (vllm-project#4685)

  WoosukKwon

  authored
  5510cf0

  Copy full SHA for 5510cf0

• [Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi (vllm-project#4573)

  DefTruth

  authored
  0f9a6e3

  Copy full SHA for 0f9a6e3

• [CI] Make mistral tests pass (vllm-project#4596)

  rkooo567

  authored
  f6a5930

  Copy full SHA for f6a5930

• [Core] Optimize sampler get_logprobs (vllm-project#4594)

  rkooo567

  authored
  d7740ea

  Copy full SHA for d7740ea

• [Core][Distributed] support cpu&device in broadcast tensor dict (vllm-project#4660)

  Show description for cc466a3
  youkaichao

  authored
  cc466a3

  Copy full SHA for cc466a3

Commits on May 7, 2024

• [Bug fix][Core] fixup ngram not setup correctly (vllm-project#4551)

  Show description for 8344f77
  

  4 peopleauthored
  8344f77

  Copy full SHA for 8344f77

• [Core][Optimization] change copy-on-write from dict[int, list] to list (vllm-project#4648)

  youkaichao

  authored
  469f85c

  Copy full SHA for 469f85c

• [Bugfix] Fixed error in slice_lora_b for MergedQKVParallelLinearWithLora (vllm-project#4609)

  FurtherAI

  authored
  10760da

  Copy full SHA for 10760da

• [Build/CI] Fixing 'docker run' to re-enable AMD CI tests. (vllm-project#4642)

  Alexei-V-Ivanov-AMD

  authored
  478aed5

  Copy full SHA for 478aed5

• [Core][Optimization] change python dict to pytorch tensor (vllm-project#4607)

  youkaichao

  authored
  63575bc

  Copy full SHA for 63575bc

• [Kernel] Make static FP8 scaling more robust (vllm-project#4570)

  Show description for a98187c
  pcmoritz

  authored
  a98187c

  Copy full SHA for a98187c

Commits on May 6, 2024

• Update lm-format-enforcer to 0.10.1 (vllm-project#4631)

  noamgat

  authored
  bd99d22

  Copy full SHA for bd99d22

• [CI] Add retry for agent lost (vllm-project#4633)

  cadedaniel

  authored
  19cb471

  Copy full SHA for 19cb471

• [CI] use ccache actions properly in release workflow (vllm-project#4629)

  simon-mo

  authored
  e186d37

  Copy full SHA for e186d37

• [Bugfix] Fix asyncio.Task not being subscriptable (vllm-project#4623)

  DarkLight1337

  authored
  323f27b

  Copy full SHA for 323f27b

Commits on May 5, 2024

• Disable cuda version check in vllm-openai image (vllm-project#4530)

  zhaoyang-star

  authored
  0650e59

  Copy full SHA for 0650e59

• [CI] Reduce wheel size by not shipping debug symbols (vllm-project#4602)

  simon-mo

  authored
  c7f2cf2

  Copy full SHA for c7f2cf2

• bump version to v0.4.2 (vllm-project#4600)

  simon-mo

  authored
  8d8357c

  Copy full SHA for 8d8357c

Commits on May 4, 2024

• [Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (vllm-project#3937)

  DearPlanet

  authored
  4302987

  Copy full SHA for 4302987

• [CI] check size of the wheels (vllm-project#4319)

  simon-mo

  authored
  021b1a2

  Copy full SHA for 021b1a2

• [Kernel] Support MoE Fp8 Checkpoints for Mixtral (Static Weights with Dynamic/Static Activations) (vllm-project#4527)

  Show description for 2a05201
  mgoin

  authored
  2a05201

  Copy full SHA for 2a05201

• [Doc] Chunked Prefill Documentation (vllm-project#4580)

  rkooo567

  authored
  36fb68f

  Copy full SHA for 36fb68f

• [Misc][Refactor] Introduce ExecuteModelData (vllm-project#4540)

  comaniac

  authored
  bc8ad68

  Copy full SHA for bc8ad68

Commits on May 3, 2024

• [Misc] add installation time env vars (vllm-project#4574)

  youkaichao

  authored
  344bf7c

  Copy full SHA for 344bf7c

• [Speculative decoding] Support target-model logprobs (vllm-project#4378)

  cadedaniel

  authored
  ab50275

  Copy full SHA for ab50275

• [Kernel] Use flashinfer for decoding (vllm-project#4353)

  Show description for 43c413e
  

  LiuXiaoxuanPKU

  and

  LiuXiaoxuanPKU

  authored
  43c413e

  Copy full SHA for 43c413e

• Fix/async chat serving (vllm-project#2727)

  schoennenbeck

  authored
  f8e7add

  Copy full SHA for f8e7add

• [Bugfix] Allow "None" or "" to be passed to CLI for string args that default to None (vllm-project#4586)

  mgoin

  authored
  7e65477

  Copy full SHA for 7e65477

• [Core][Model runner refactoring 1/N] Refactor attn metadata term (vllm-project#4518)

  rkooo567

  authored
  3521ba4

  Copy full SHA for 3521ba4

• [Doc] add env vars to the doc (vllm-project#4572)

  youkaichao

  authored
  2d7bce9

  Copy full SHA for 2d7bce9

• [Misc] remove chunk detected debug logs (vllm-project#4571)

  DefTruth

  authored
  ce3f1ee

  Copy full SHA for ce3f1ee

Pagination

Previous

Next