Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
30 Open 893 Closed
30 Open 893 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

CI: install nvidia-nvshmem-cu12
#1262 opened Jul 15, 2025 by EmilienM Loading…
5 tasks done
4
feat(aot): add nvshmem module for aot compilation
#1261 opened Jul 15, 2025 by EmilienM Loading…
3 of 5 tasks
1
11
refactor: separate SM100 and legacy TRT-LLM comm modules
#1259 opened Jul 15, 2025 by EmilienM Loading…
3 of 5 tasks
1
9
feat: enable trtllm-gen mla MTP
#1258 opened Jul 15, 2025 by yyihuang Loading…
5 tasks
2
feat: update scale factor interface for trtllm-gen mla kernels.
#1248 opened Jul 14, 2025 by yyihuang Loading…
5 tasks done
4
bugfix: fix fp32 acc threshold for qk using math::inf according to dtype by AIDC-AI
#1247 opened Jul 14, 2025 by yongchaoding Loading…
5 tasks done
4
Add the keyword "template" to member template specialization appears after . or -> in a post-fix expression which is a requirement in C++ standard
#1246 opened Jul 14, 2025 by tomflinda Loading…
9
Mnnvl memory with custom communicator
#1245 opened Jul 14, 2025 by wenscarl • Draft
5 tasks
2
Add trtllm-gen attention mha kernel with FP8 Q/K/V and FP8 output
#1242 opened Jul 11, 2025 by weireweire Loading…
18
add trtllm-gen context attention
#1239 opened Jul 10, 2025 by IwakuraRein Loading…
3 of 5 tasks
16
feat: expose python APIs for cutlass blackwell fmha fp8 kernels
#1238 opened Jul 10, 2025 by yzh119 • Draft
5 tasks
7
feat: Restore convenience FLASHINFER_ENABLE_AOT option
#1235 opened Jul 8, 2025 by mgorny Loading…
3 of 5 tasks
7
[Feature] Support batch prefill for POD Attention
#1231 opened Jul 8, 2025 by Edenzzzz Loading…
6 tasks
1
12
Feature/sm100 low latency nvfp4 kernels priority: high
#1214 opened Jul 4, 2025 by azhurkevich Loading…
1 of 5 tasks
@yzh119 @zhyncs
7
Add ruff to pre-commit
#1201 opened Jul 1, 2025 by cyx-6 • Draft
5 tasks
4
jit: supporting transform output in attention jit template
#1184 opened Jun 27, 2025 by yzh119 • Draft
5 tasks
4
Add mypy to pre-commit
#1179 opened Jun 26, 2025 by cyx-6 • Draft
5 tasks
5
Use flashinfer softmax in top_k_top_p_sampling_from_logits
#1171 opened Jun 24, 2025 by lgeiger Loading…
5 tasks done
11
[wip] Multimem allreduce cutlass dsl
#1169 opened Jun 23, 2025 by Amir-19 • Draft
5 tasks
11
Port AllGather/ReduceScatter from TensorRT-LLM
#1145 opened Jun 15, 2025 by wenscarl Loading…
5 tasks
22
[wip] refactor: add more features to vec_t
#1142 opened Jun 12, 2025 by yzh119 • Draft
5 tasks
28
[WIP] refactor: unifying return status of different backend implementation
#1141 opened Jun 12, 2025 by yzh119 Loading…
5 tasks
2
[wip] ci: update pre-commits
#1094 opened May 26, 2025 by yzh119 Loading…
5 tasks
feat: add mla custom mask
#1017 opened Apr 13, 2025 by yyihuang • Draft
FlashInfer Windows support
#964 opened Mar 21, 2025 by SystemPanic Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.