Skip to content

Issues: vllm-project/vllm

[RFC]: Deprecating vLLM V0
#18571 opened May 22, 2025 by WoosukKwon
Open 30
[Roadmap] vLLM Roadmap Q2 2025
#15735 opened Mar 29, 2025 by simon-mo
Open 15
[Roadmap] vLLM Release/CI/Performance Benchmark Q2 2025
#16284 opened Apr 8, 2025 by khluu
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
19 Open 213 Closed
19 Open 213 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Misc][Help]: Adding support for a Custom model with External MoE Routing misc
#15214 opened Mar 20, 2025 by XMaster96
1 task done
[Misc]: why 3B-Instruct-AWQ takes 16G misc
#15204 opened Mar 20, 2025 by shaojun
1 task done
1
[Misc]: Why not sort the waiting queue before popleft waiting queue? misc
#15091 opened Mar 19, 2025 by zh-jp
1 task done
[CI failed]: V1 Test Failed due to "No available memory for the cache blocks" in GitHub Actions misc
#14574 opened Mar 10, 2025 by cynthieye
1 task done
1
[Misc]: asyncio requests and continuous batching misc
#14559 opened Mar 10, 2025 by Bodoral
1 task done
[Misc, this is not a dev issue]: Congrats to vllm for having 888 developers! misc
#14405 opened Mar 7, 2025 by ZihanWang314
1 task done
1
[Misc]: running multiple vLLM instances on a single ray cluster misc ray anything related with ray stale Over 90 days of inactivity
#14277 opened Mar 5, 2025 by gitlawr
1 task done
3
[Misc]: How does the system evenly distribute the requests to multiple micro batches? misc stale Over 90 days of inactivity
#14213 opened Mar 4, 2025 by oldcpple
1 task done
1
[Misc]: When using lossy optimization, how to explain that the loss caused by optimization is within the acceptable range? misc
#14128 opened Mar 3, 2025 by nodekey777
1 task done
6
[Misc]: Performance Increase When Running Benchmarks on Docker Container misc
#14006 opened Feb 28, 2025 by jingeekim9
1 task done
1
[Misc] [ROCm]: Build from source failure with Arch/gcc14 with ROCm 6.3 misc
#13777 opened Feb 24, 2025 by arjunkathuria
1 task done
5
[Misc]: Why do we need to explicitly pass tool parsers? misc stale Over 90 days of inactivity
#13399 opened Feb 17, 2025 by Datta0
1 task done
1
[Misc]: How does vllm consume request in async mode？ misc stale Over 90 days of inactivity
#13328 opened Feb 15, 2025 by mru4913
1 task done
1
[Misc]: Question: Where can I find getting computed kv cache code on v0. misc
#13327 opened Feb 15, 2025 by hiroki-nishimoto-fixstars
1 task done
1
[Misc]: Regarding the issue of inconsistent calculation of tokens misc stale Over 90 days of inactivity
#13256 opened Feb 14, 2025 by lgy1027
1 task done
2
[Feature]: Support Python 3.13 misc
#12083 opened Jan 15, 2025 by manueldeprada
1 task done
1
4
[Misc]: CMake Clean-up / Refactor Tasks misc
#9129 opened Oct 7, 2024 by LucasWilkinson
6 tasks
5
[Misc]: Strange leaked shared_memory warnings reported by multiprocessing when using vLLM misc
#8803 opened Sep 25, 2024 by shaoyuyoung
1 task done
22
[Misc]: I want to run Llama 3.1 405B using speculative. Can you give me a guide? misc stale Over 90 days of inactivity
#7456 opened Aug 13, 2024 by Archmilio
6
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.