Skip to content

Issues: vllm-project/vllm

[RFC]: Deprecating vLLM V0
#18571 opened May 22, 2025 by WoosukKwon
Open 27
[Roadmap] vLLM Roadmap Q2 2025
#15735 opened Mar 29, 2025 by simon-mo
Open 15
[Roadmap] vLLM Release/CI/Performance Benchmark Q2 2025
#16284 opened Apr 8, 2025 by khluu
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
51 Open 165 Closed
51 Open 165 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bugfix]: Fix the incompatibility issue with Structured Outputs when Thinking is disabled structured-output v1
#18879 opened May 29, 2025 by chaunceyjiang Loading…
1
4
[Deprecation] Remove prompt_token_ids arg fallback in LLM.generate and LLM.embed documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed structured-output v1
#18800 opened May 28, 2025 by DarkLight1337 • Draft
3
[Core] feat: Implement Priority Scheduling in V1 Engine ci/build documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) needs-rebase structured-output tool-calling v1
#18700 opened May 26, 2025 by amitm02 Loading…
1
2
[CUDA] Enable full cudagraph for FlashMLA frontend structured-output v1
#18581 opened May 23, 2025 by ProExpertProg Loading…
6
[Doc] Unify structured outputs examples documentation Improvements or additions to documentation needs-rebase structured-output
#18196 opened May 15, 2025 by aarnphm Loading…
8
Support embedding models in V1 with a dedicated model_runner frontend needs-rebase structured-output tpu Related to Google TPUs v1
#18015 opened May 12, 2025 by maxdebayser Loading…
26
[RFC]: Unification of frontend parser RFC structured-output tool-calling
#17817 opened May 7, 2025 by aarnphm
@aarnphm
[Fix] Auto-detect XGrammar compiler threads based on CPU cores. documentation Improvements or additions to documentation needs-rebase structured-output v1
#17737 opened May 6, 2025 by Ubospica Loading…
20
[RFC][core][V1] generalize structured output manager and backends structured-output tpu Related to Google TPUs v1
#17503 opened Apr 30, 2025 by william-baker-inflection Loading…
24
[benchmark][structured output] Add offline benchmark script for structured output needs-rebase structured-output
#17440 opened Apr 30, 2025 by lk-chen Loading…
3
[Feature][CLI] Unify configuration for structured outputs via --structured-outputs-config documentation Improvements or additions to documentation frontend needs-rebase structured-output tool-calling v1
#17420 opened Apr 29, 2025 by aarnphm Loading…
69
Remove Zephyr 7B from everywhere possible in CI ready ONLY add when PR is ready to merge/full CI is needed structured-output
#17401 opened Apr 29, 2025 by hmellor Loading…
3
[Bug]: guided_grammar example syntax does not work bug Something isn't working structured-output
#16911 opened Apr 21, 2025 by Famondir
1 task done
[Bug]: [v0.8.4][Critical] Tools calling broken: xgrammar rejects minItems in JSON Schema, blocking agent functionality bug Something isn't working structured-output tool-calling
#16880 opened Apr 19, 2025 by okamiRvS
1 task done
1
@russellb
5
[V1] LogitsProcessor programming model ci/build documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) speculative-decoding structured-output tool-calling v1
#16728 opened Apr 16, 2025 by afeldman-nm Loading…
30
[Feature]: Disable unicode characters in structured decoding feature request New feature or request structured-output
#16363 opened Apr 9, 2025 by sethkimmel3
1 task done
4
[Bug]: issues with guided generation for tool calls (xgrammar) bug Something isn't working structured-output tool-calling
#16321 opened Apr 9, 2025 by Rendok
1
Support embedding models in V1 frontend needs-rebase structured-output tpu Related to Google TPUs v1
#16188 opened Apr 7, 2025 by maxdebayser Loading…
43
[V0][V1][Core] Add outlines integration for V1, and update V0 integration. ci/build ready ONLY add when PR is ready to merge/full CI is needed structured-output tool-calling v1
#15975 opened Apr 3, 2025 by unaidedelf8777 Loading…
@russellb @aarnphm
66
[Bug]: xgrammar==0.17 not work when guided bug Something isn't working structured-output
#15790 opened Mar 31, 2025 by jacksonjack001
1 task done
[Bug]: gemma 3 structured output api occurs assertion error bug Something isn't working structured-output
#15766 opened Mar 30, 2025 by Shuntw6096
1 task done
7
[Bug]: xgrammar doesn't support enums, but vllm isn't falling back to outlines bug Something isn't working structured-output
#15762 opened Mar 30, 2025 by ivnle
1
[Bug]: Outlines broken on vLLM 0.8+ bug Something isn't working structured-output
#15636 opened Mar 27, 2025 by cpfiffer
9
Enable Outlines with JSON Sub-Schema References frontend needs-rebase structured-output
#15627 opened Mar 27, 2025 by theobjectivedad Loading…
1
13
[Bug]: guided_json not working correctly with (quantized) mistral-small model bug Something isn't working structured-output
#15577 opened Mar 26, 2025 by VMinB12
1 task done
4
ProTip! Follow long discussions with comments:>50.