Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q4 2024
#9006 opened Oct 1, 2024 by simon-mo
Open 15
vLLM's V2 Engine Architecture
#8779 opened Sep 24, 2024 by simon-mo
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
35 Open 14 Closed
35 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Frontend] Rename and auto-detect --chat-template-text-format documentation Improvements or additions to documentation frontend
#9919 opened Nov 1, 2024 by DarkLight1337 • Draft
1
[Bugfix] Hermes tool parser fails to check for & handle None values in some cases frontend
#9908 opened Nov 1, 2024 by K-Mistele • Draft
2
1
[V1] Make v1 more testable ci/build frontend
#9888 opened Oct 31, 2024 by joerunde Loading…
2
[Frontend] Pythonic tool parser frontend
#9859 opened Oct 30, 2024 by mdepinet Loading…
4
[V1] AsyncLLMEngine Proposal frontend
#9826 opened Oct 30, 2024 by robertgshaw2-neuralmagic • Draft
6
Prototyping LLMEngineCore frontend
#9782 opened Oct 29, 2024 by robertgshaw2-neuralmagic • Draft
2
[Frontend]: enable state callbacks for offline inference ci/build frontend
#9780 opened Oct 29, 2024 by sethkimmel3 Loading…
1
[Model] add tool parser for openbmb/MiniCPM3-4B documentation Improvements or additions to documentation frontend
#9762 opened Oct 28, 2024 by Cppowboy Loading…
6
check could commit frontend needs-rebase
#9749 opened Oct 28, 2024 by YaaoTu Loading…
3
[Model] Add support for H2OVL-Mississippi models documentation Improvements or additions to documentation frontend
#9747 opened Oct 28, 2024 by cooleel Loading…
@ywang96
21
[Core] Support offloading KV cache to CPU frontend
#9682 opened Oct 25, 2024 by KuntaiDu Loading…
3
Adds method to read the pooling types from model's files frontend
#9506 opened Oct 18, 2024 by flaviabeo Loading…
1
38
【Frontend】Add sampler_priority and repetition_penalty_range frontend
#9485 opened Oct 18, 2024 by ZeroYuJie Loading…
2
[Feature] [Spec decode]: Combine chunked prefill with speculative decoding ci/build documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed
#9291 opened Oct 11, 2024 by NickLucche Loading…
3 of 5 tasks
@comaniac @LiuXiaoxuanPKU
54
[Frontend] Tool calling parser for Granite 3.0 models ci/build documentation Improvements or additions to documentation frontend
#9027 opened Oct 2, 2024 by maxdebayser Loading…
9
[Frontend] Add security scheme to server frontend needs-rebase stale
#7021 opened Aug 1, 2024 by g-parki Loading…
1
4
[Frontend] Entrypoint for hosting local Kobold Lite chat interface frontend needs-rebase stale
#4096 opened Apr 15, 2024 by mgoin Loading…
2
Dynamic Multi LoRA Load \ Delete Support frontend needs-rebase stale
#3496 opened Mar 19, 2024 by gauravkr2108 Loading…
1
8
[Core] Support thread-based async tokenizer pools frontend needs-rebase stale
#3449 opened Mar 16, 2024 by njhill Loading…
@Yard1
21
[Frontend] support new lora module to a live server in OpenAI Entrypoints frontend needs-rebase stale
#3446 opened Mar 16, 2024 by AlphaINF Loading…
5
Implement structured engine for parsing json grammar by token with response_format: {type: json_object} frontend needs-rebase stale
#3328 opened Mar 12, 2024 by pathorn Loading…
3
Supporting embedding models frontend needs-rebase
#3187 opened Mar 4, 2024 by jc9123 Loading…
1
@robertgshaw2-neuralmagic
44
feat: quadratic + cubic sampling frontend needs-rebase stale
#3167 opened Mar 3, 2024 by AlpinDale Loading…
13
Fix: Echo without asking for new tokens or logprobs in OpenAI Completions API frontend needs-rebase stale
#2995 opened Feb 22, 2024 by matheper Loading…
1
@DarkLight1337
4
FIX: llm entry, for enable lora frontend needs-rebase stale
#2889 opened Feb 16, 2024 by suncl1990 Loading…
3
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.