Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q4 2024
#9006 opened Oct 1, 2024 by simon-mo
Open 26
vLLM's V1 Engine Architecture
#8779 opened Sep 24, 2024 by simon-mo
Open 10
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
68 Open 245 Closed
68 Open 245 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Update amd-installation.md ci/build documentation Improvements or additions to documentation
#11470 opened Dec 24, 2024 by johnnynunez Loading…
3
[Frontend] improve hermes_tool_parser.py ci/build frontend
#11453 opened Dec 24, 2024 by paulcx Loading…
1
[Platform] More consistent entrypoints across different platforms ci/build
#11448 opened Dec 24, 2024 by terrytangyuan Loading…
3
[Model][LoRA]LoRA support added for MolmoForCausalLM ci/build documentation Improvements or additions to documentation frontend needs-rebase
#11439 opened Dec 23, 2024 by ayylemao Loading…
1
7
fix: add missing bos_token to example templates ci/build
#11432 opened Dec 23, 2024 by toslunar Loading…
5
Zhn/fish e2e merge ci/build
#11426 opened Dec 23, 2024 by niuzheng168 • Draft
1
Bump helm/kind-action from 1.10.0 to 1.11.0 ci/build dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#11424 opened Dec 23, 2024 by dependabot bot Loading…
1
[V1] Optimize block table transfer from CPU to GPU ci/build
#11401 opened Dec 22, 2024 by WoosukKwon • Draft
5
[VLM] Support caching in merged multi-modal processor ci/build documentation Improvements or additions to documentation
#11396 opened Dec 21, 2024 by DarkLight1337 Loading…
3
Update Dockerfile.rocm ci/build
#11387 opened Dec 20, 2024 by yx-lamini Loading…
2
[Kernel] Add ExLlamaV2 Weight Quantization Support ci/build kernel quantization
#11348 opened Dec 19, 2024 by AlpinDale • Draft
1
4
DRAFT: Add transformers backend support ci/build
#11330 opened Dec 19, 2024 by ArthurZucker • Draft
4
Update Dockerfile.tpu pin to nightly torch_xla ci/build
#11309 opened Dec 18, 2024 by ManfeiBai Loading…
6
[Model] Whisper model implementation ci/build
#11280 opened Dec 18, 2024 by aurickq Loading…
1
27
[CI/Build] Adds Modal runners for performance benchmark ci/build
#11239 opened Dec 16, 2024 by erik-dunteman Loading…
3
[Kernel][LoRA]Punica prefill kernels fusion ci/build
#11234 opened Dec 16, 2024 by jeejeelee • Draft
1
[Platform] Add platform pluggable framework ci/build documentation Improvements or additions to documentation
#11222 opened Dec 16, 2024 by wangxiyuan Loading…
37
[Hardware][CPU] Multi-LoRA implementation for the CPU backend ci/build documentation Improvements or additions to documentation frontend
#11100 opened Dec 11, 2024 by Akshat-Tripathi Loading…
50
[CI/Build] Increase VLLM_MAX_SIZE_MB to 300M ci/build
#11053 opened Dec 10, 2024 by tolak Loading…
3
Avoid mistakenly picking Gaudi/HPU if XPU is requested. ci/build
#11018 opened Dec 9, 2024 by janimo Loading…
5
[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations ci/build frontend ready ONLY add when PR is ready to merge/full CI is needed
#10867 opened Dec 3, 2024 by SageMoore Loading…
36
[CI]add genai-perf benchmark in nightly benchmark ci/build nightly-benchmarks perf-benchmarks
#10704 opened Nov 27, 2024 by jikunshang Loading…
24
[Core] Integrate Fastsafetensor loader for loading model weights ci/build documentation Improvements or additions to documentation
#10647 opened Nov 26, 2024 by manish-sethi • Draft
1
Turn on V1 for H200 build ci/build perf-benchmarks
#10505 opened Nov 21, 2024 by simon-mo Loading…
1
[Frontend] Add Command-R and Llama-3 chat template ci/build frontend
#10496 opened Nov 20, 2024 by ccs96307 Loading…
1
7
ProTip! Adding no:label will show everything without a label.