Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q4 2024
#9006 opened Oct 1, 2024 by simon-mo
Open 15
vLLM's V2 Engine Architecture
#8779 opened Sep 24, 2024 by simon-mo
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
70 Open 5 Closed
70 Open 5 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Kernels] Add an inductor pass to rewrite and fuse collective communication ops with gemms needs-rebase
#9886 opened Oct 31, 2024 by bnellnm • Draft
2
[Kernels] Add an inductor pass to rewrite and fuse collective communication ops with gemms (WIP not for review) needs-rebase
#9883 opened Oct 31, 2024 by bnellnm • Draft
2
[V1] Support VLMs needs-rebase
#9871 opened Oct 31, 2024 by WoosukKwon • Draft
@ywang96
10
check could commit frontend needs-rebase
#9749 opened Oct 28, 2024 by YaaoTu Loading…
3
[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#9559 opened Oct 21, 2024 by sroy745 Loading…
@ywang96
39
Pytorch hete spec needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#9266 opened Oct 11, 2024 by jiqing-feng Loading…
3
Developed the PoC of dAttention support. It will utilize the similar idea of vAttention, but it introduces a new memory layout that overcomes the waste of memory of vAttention. ci/build needs-rebase
#9078 opened Oct 4, 2024 by tongping Loading…
2
[Model] factoring out MambaMixer out of Jamba ci/build needs-rebase
#8993 opened Oct 1, 2024 by mzusman • Draft
2
[Core][VLM] Add support for placeholder token content hashes needs-rebase
#8348 opened Sep 10, 2024 by petersalas Loading…
1
@ywang96
21
[Core][VLM] Add precise multi-modal placeholder tracking needs-rebase
#8346 opened Sep 10, 2024 by petersalas Loading…
@ywang96
76
[Hardware][Ascend] Add Ascend NPU backend needs-rebase
#8054 opened Aug 31, 2024 by wangshuai09 • Draft
11 of 12 tasks
65
[Misc] p90 and p95 for serving benchmark needs-rebase stale
#7062 opened Aug 2, 2024 by UranusSeven Loading…
5
[Frontend] Add security scheme to server frontend needs-rebase stale
#7021 opened Aug 1, 2024 by g-parki Loading…
1
4
[CI/Build] Adding timeout in CPU CI to avoid CPU test queue blocking ci/build needs-rebase ready ONLY add when PR is ready to merge/full CI is needed stale
#6892 opened Jul 29, 2024 by bigPYJ1151 Loading…
4
Add required libcuda.so ci/build needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#6864 opened Jul 27, 2024 by sdake Loading…
10
[Model] Add support for Qwen2 for embeddings needs-rebase stale
#5611 opened Jun 17, 2024 by mgoin Loading…
2
15
Adding idefics2 needs-rebase stale
#4937 opened May 21, 2024 by jc9123 Loading…
1
@ywang96
16
[Kernel][Core][WIP] Tree attention and parallel decoding needs-rebase stale
#4325 opened Apr 24, 2024 by yukavio Loading…
4
Add temperature to beam search needs-rebase stale
#4230 opened Apr 21, 2024 by ayusher Loading…
2
[Model] Add moondream vision language model documentation Improvements or additions to documentation needs-rebase stale
#4228 opened Apr 20, 2024 by vikhyat Loading…
7
[Frontend] Entrypoint for hosting local Kobold Lite chat interface frontend needs-rebase stale
#4096 opened Apr 15, 2024 by mgoin Loading…
2
[Model] Adding sliding window support for block table [#3665] needs-rebase stale
#3967 opened Apr 10, 2024 by ruthe98 Loading…
1
@rkooo567
7
FP8 MoE implementation, take 2 needs-rebase stale
#3954 opened Apr 10, 2024 by pcmoritz Loading…
2
[Bugfix] Add Prefix Caching Warmup Step action-required needs-rebase stale
#3901 opened Apr 7, 2024 by robertgshaw2-neuralmagic Loading…
1
@zhuohan123
12
Dynamic Multi LoRA Load \ Delete Support frontend needs-rebase stale
#3496 opened Mar 19, 2024 by gauravkr2108 Loading…
1
8
ProTip! What’s not been updated in a month: updated:<2024-10-01.