Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 26, 2024

• [Minor] Remove gather_cached_kv kernel (vllm-project#3043)

  WoosukKwon

  authored
  d6e4a13

  Copy full SHA for d6e4a13

Commits on Feb 1, 2024

• Fix compile error when using rocm (vllm-project#2648)

  zhaoyang-star

  authored
  923797f

  Copy full SHA for 923797f

Commits on Jan 29, 2024

• Support FP8-E5M2 KV Cache (vllm-project#2279)

  Show description for 9090bf0
  

  3 peopleauthored
  9090bf0

  Copy full SHA for 9090bf0

Commits on Jan 26, 2024

• use a correct device when creating OptionalCUDAGuard (vllm-project#2583)

  sh1ng

  authored
  5265631

  Copy full SHA for 5265631

Commits on Jan 3, 2024

• [FIX] Support non-zero CUDA devices in custom kernels (vllm-project#1959)

  jeejeelee

  authored
  77af974

  Copy full SHA for 77af974

Commits on Dec 8, 2023

• Merge EmbeddedLLM/vllm-rocm into vLLM main (vllm-project#1836)

  Show description for 6ccc0bf
  

  4 peopleauthored
  6ccc0bf

  Copy full SHA for 6ccc0bf

Commits on Oct 31, 2023

• Fix integer overflows in attention & cache ops (vllm-project#1514)

  WoosukKwon

  authored
  0ce8647

  Copy full SHA for 0ce8647

Commits on Oct 17, 2023

• Change scheduler & input tensor shape (vllm-project#1381)

  WoosukKwon

  authored
  c1376e0

  Copy full SHA for c1376e0

Commits on Sep 2, 2023

• Avoid compiling kernels for double data type (vllm-project#933)

  WoosukKwon

  authored
  8ce9c50

  Copy full SHA for 8ce9c50

Commits on Jun 17, 2023

• Change the name to vLLM (vllm-project#150)

  WoosukKwon

  authored
  0b98ba1

  Copy full SHA for 0b98ba1

Commits on May 3, 2023

• Support bfloat16 data type (vllm-project#54)

  WoosukKwon

  authored
  e070829

  Copy full SHA for e070829

Commits on Apr 11, 2023

• Memcpy kernel for flash attention (vllm-project#29)

  Show description for e3cec88
  suquark

  authored
  e3cec88

  Copy full SHA for e3cec88

Commits on Apr 8, 2023

• Implement block copy kernel to optimize beam search (vllm-project#32)

  WoosukKwon

  authored
  0f40557

  Copy full SHA for 0f40557

Commits on Apr 2, 2023

• Optimize data movement (vllm-project#20)

  WoosukKwon

  authored
  897cb2a

  Copy full SHA for 897cb2a

Commits on Mar 30, 2023

• Implement custom kernel for LLaMA rotary embedding (vllm-project#14)

  WoosukKwon

  authored
  88c0268

  Copy full SHA for 88c0268

Commits on Mar 13, 2023

• Add miscellaneous updates (vllm-project#8)

  WoosukKwon

  authored
  cfae35b

  Copy full SHA for cfae35b

Commits on Mar 10, 2023

• Support beam search & parallel generation (vllm-project#7)

  WoosukKwon

  authored
  1a7eb7d

  Copy full SHA for 1a7eb7d

Commits on Mar 1, 2023

• Implement single_query_cached_kv_attention kernel (vllm-project#3)

  WoosukKwon

  authored
  0deacbc

  Copy full SHA for 0deacbc

Commits on Feb 18, 2023

• Add reshape_and_cache op

  WoosukKwon

  committed
  c413c41

  Copy full SHA for c413c41

Commits on Feb 16, 2023

• cache_kernel -> cache_kernels

  WoosukKwon

  committed
  ffad4e1

  Copy full SHA for ffad4e1

Loading