This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commits

Commits on Feb 21, 2024

Commits on Feb 16, 2024

Bump up to v0.3.1 (vllm-project#2887 )
WoosukKwon
authored

Commits on Feb 15, 2024

[BugFix] Fix GC bug for LLM class (vllm-project#2882 )
WoosukKwon
authored

Commits on Feb 14, 2024

Don't use cupy NCCL for AMD backends (vllm-project#2855 )
WoosukKwon
authored
[Fix] Fix memory profiling when GPU is used by multiple processes (vllm-project#2863 )
WoosukKwon
authored

Commits on Feb 13, 2024

Use CuPy for CUDA graphs (vllm-project#2811 )
WoosukKwon
authored

Commits on Feb 8, 2024

Disable custom all reduce by default (vllm-project#2808 )
WoosukKwon
authored

Commits on Feb 6, 2024

Add fused top-K softmax kernel for MoE (vllm-project#2769 )
WoosukKwon
authored

Commits on Feb 5, 2024

[Minor] Fix benchmark_latency script (vllm-project#2765 )
WoosukKwon
authored

Commits on Jan 31, 2024

Add quantized mixtral support (vllm-project#2673 )
WoosukKwon
authored

Commits on Jan 30, 2024

[Minor] Fix false warning when TP=1 (vllm-project#2674 )
WoosukKwon
authored

Commits on Jan 28, 2024

Speed up Punica compilation (vllm-project#2632 )
WoosukKwon
authored

Commits on Jan 27, 2024

[Minor] Fix warning on Ray dependencies (vllm-project#2630 )
WoosukKwon
authored

Commits on Jan 15, 2024

Announce the second vLLM meetup (vllm-project#2444 )
WoosukKwon
authored

Commits on Jan 12, 2024

Commits on Jan 8, 2024

Commits on Jan 4, 2024

Commits on Jan 3, 2024

Enable CUDA graph for GPTQ & SqueezeLLM (vllm-project#2318 )
WoosukKwon
authored

Commits on Dec 21, 2023

Commits on Dec 20, 2023

[BugFix] Fix weight loading for Mixtral with TP (vllm-project#2208 )
WoosukKwon
authored

Commits on Dec 19, 2023

Add warning on CUDA graph memory usage (vllm-project#2182 )
WoosukKwon
authored

Commits on Dec 18, 2023