Search results

[Misc][Help]: Adding support for a Custom model with External MoE Routing

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#15214 In vllm-project/vllm;

· XMaster96 opened on Mar 20, 2025

[Misc]: Why not sort the waiting queue before popleft waiting queue?

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#15091 In vllm-project/vllm;

· zh-jp opened on Mar 19, 2025

[CI failed]: V1 Test Failed due to "No available memory for the cache blocks" in GitHub Actions

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14574 In vllm-project/vllm;

· cynthieye opened on Mar 10, 2025

[Misc]: asyncio requests and continuous batching

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14559 In vllm-project/vllm;

· Bodoral opened on Mar 10, 2025

[Misc, this is not a dev issue]: Congrats to vllm for having 888 developers!

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14405 In vllm-project/vllm;

· ZihanWang314 opened on Mar 7, 2025

[Misc]: running multiple vLLM instances on a single ray cluster

misc

rayanything related with rayanything related with ray

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14277 In vllm-project/vllm;

· gitlawr opened on Mar 5, 2025

[Misc]: How does the system evenly distribute the requests to multiple micro batches?

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14213 In vllm-project/vllm;

· oldcpple opened on Mar 4, 2025

[Misc]: When using lossy optimization, how to explain that the loss caused by optimization is within the acceptable range?

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14128 In vllm-project/vllm;

· nodekey777 opened on Mar 3, 2025

[Misc]: Performance Increase When Running Benchmarks on Docker Container

misc

staleOver 90 days of inactivityOver 90 days of inactivity

Status: Open.

#14006 In vllm-project/vllm;

· jingeekim9 opened on Feb 28, 2025

[Misc] [ROCm]: Build from source failure with Arch/gcc14 with ROCm 6.3

misc

Status: Open.

#13777 In vllm-project/vllm;

· arjunkathuria opened on Feb 24, 2025

[Misc]: Question: Where can I find getting computed kv cache code on v0.

misc

Status: Open.

#13327 In vllm-project/vllm;

· hiroki-nishimoto-fixstars opened on Feb 15, 2025

[Feature]: Support Python 3.13

misc

Status: Open.

#12083 In vllm-project/vllm;

· manueldeprada opened on Jan 15, 2025