Skip to content

Pull requests: vllm-project/vllm

New pull request New
Clear current search query, filters, and sorts
20 Open 192 Closed
20 Open 192 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[V0 deprecation] Guided decoding ci/build frontend needs-rebase ready ONLY add when PR is ready to merge/full CI is needed structured-output v1
#21347 opened Jul 22, 2025 by rzabarazesh Loading…
1 of 4 tasks
9
Convert tests to ruff-format deepseek Related to DeepSeek models llama Related to Llama models multi-modality Related to multi-modality (#4194) needs-rebase performance Performance-related issues qwen Related to Qwen models rocm Related to AMD ROCm speculative-decoding structured-output tool-calling tpu Related to Google TPUs v1
#21129 opened Jul 17, 2025 by hmellor Loading…
5
[benchmark] add max-concurrency in result table performance Performance-related issues ready ONLY add when PR is ready to merge/full CI is needed structured-output
#21095 opened Jul 17, 2025 by panpan0000 Loading…
2 of 3 tasks
1
10
[V0 deprecation] Removal V0 structured outputs needs-rebase ready ONLY add when PR is ready to merge/full CI is needed structured-output
#20928 opened Jul 14, 2025 by aarnphm Loading… v0.10.0
7
[WIP][RC] Update PyTorch to 2.8.0 ci/build deepseek Related to DeepSeek models documentation Improvements or additions to documentation frontend llama Related to Llama models multi-modality Related to multi-modality (#4194) new-model Requests to new models performance Performance-related issues qwen Related to Qwen models rocm Related to AMD ROCm speculative-decoding structured-output tool-calling v1
#20358 opened Jul 2, 2025 by huydhn • Draft
@sangstar
15
Add support for Prithvi geospatial model in serving mode documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) needs-rebase new-model Requests to new models structured-output v1
#20307 opened Jul 1, 2025 by mgazz • Draft
1 of 4 tasks
19
Draft: WIP NixlConnector allow configurable handshake backend +HTTP ci/build documentation Improvements or additions to documentation frontend llama Related to Llama models multi-modality Related to multi-modality (#4194) needs-rebase performance Performance-related issues qwen Related to Qwen models rocm Related to AMD ROCm structured-output tool-calling v1
#19447 opened Jun 10, 2025 by wseaton Loading…
3 of 7 tasks
77
[Deprecation] Remove prompt_token_ids arg fallback in LLM.generate and LLM.embed documentation Improvements or additions to documentation frontend needs-rebase ready ONLY add when PR is ready to merge/full CI is needed speculative-decoding structured-output v1
#18800 opened May 28, 2025 by DarkLight1337 • Draft
4
[V1][Feat] Fail request if FSM fails to advance structured-output v1
#18780 opened May 27, 2025 by atbe Loading…
14
[Fix] Auto-detect XGrammar compiler threads based on CPU cores. documentation Improvements or additions to documentation needs-rebase structured-output v1
#17737 opened May 6, 2025 by Ubospica Loading…
20
[RFC][core][V1] generalize structured output manager and backends needs-rebase structured-output tpu Related to Google TPUs v1
#17503 opened Apr 30, 2025 by william-baker-inflection Loading…
34
[benchmark][structured output] Add offline benchmark script for structured output needs-rebase performance Performance-related issues structured-output
#17440 opened Apr 30, 2025 by lk-chen Loading…
3
[Feature][Refactor][CLI] Rename guided to structured outputs, and --structured-outputs-config documentation Improvements or additions to documentation frontend needs-rebase structured-output tool-calling v1
#17420 opened Apr 29, 2025 by aarnphm Loading…
71
[Frontend] Added support for HermesToolParser for models without special tokens ci/build documentation Improvements or additions to documentation frontend llama Related to Llama models multi-modality Related to multi-modality (#4194) performance Performance-related issues qwen Related to Qwen models rocm Related to AMD ROCm speculative-decoding structured-output tool-calling v1
#16890 opened Apr 20, 2025 by minpeter Loading…
@sangstar
9
Enable Outlines with JSON Sub-Schema References frontend needs-rebase structured-output
#15627 opened Mar 27, 2025 by theobjectivedad Loading…
1
14
Adding Share Expert Fusion for DeepSeek ci/build deepseek Related to DeepSeek models needs-rebase performance Performance-related issues ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm speculative-decoding structured-output v1
#15502 opened Mar 25, 2025 by DiegoD94 Loading…
79
[V1][Experimental] Jump-forward decoding needs-rebase qwen Related to Qwen models structured-output v1
#15490 opened Mar 25, 2025 by aarnphm • Draft
@russellb @WoosukKwon
25
[Frontend]Reduce vLLM's import time ci/build deepseek Related to DeepSeek models frontend multi-modality Related to multi-modality (#4194) needs-rebase speculative-decoding structured-output v1
#15128 opened Mar 19, 2025 by Chen-0210 Loading…
55
[Frontend] Skip stop in reasoning content documentation Improvements or additions to documentation frontend needs-rebase structured-output
#14550 opened Mar 10, 2025 by gaocegege Loading…
2
8
[Frontend] Adding the "User Defined Custom Tool Calling" parser for the Llama models ci/build documentation Improvements or additions to documentation frontend llama Related to Llama models multi-modality Related to multi-modality (#4194) needs-rebase speculative-decoding structured-output tool-calling v1
#12752 opened Feb 4, 2025 by lulmer Loading…
15
ProTip! What’s not been updated in a month: updated:<2025-06-23.