Skip to content

Pull requests: pytorch/torchtitan

New pull request New
346 Open 2,507 Closed
346 Open 2,507 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[graph_trainer] Replace stable_topological_sort with _move_overlap_nodes in fsdp_passes ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3599 opened Jun 9, 2026 by ydwu4 Contributor Loading…
Pass original size/stride as explicit args to ao.reload ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3598 opened Jun 9, 2026 by mlazos Contributor Loading…
[graph_trainer] Fix full inductor + precompile crash at TP>1 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3596 opened Jun 9, 2026 by bobrenjc93 Contributor • Draft
3 tasks
Using "virtual padding" to calculate number_local_tokens per SP rank, and fix combine() shape mismatch ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3595 opened Jun 9, 2026 by wwwjn Contributor Loading…
9
[NOT READY][RL][Continuous batching] ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3593 opened Jun 9, 2026 by felipemello1 Contributor • Draft
[graph_trainer] activation memory logging: saved-vs-total, readable symbolic shapes, split symint saves ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3591 opened Jun 9, 2026 by SherlockNoMad Contributor Loading…
[graph_trainer] Match Eager FSDP bucket order ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3590 opened Jun 9, 2026 by IvanKobzarev Contributor Loading…
[graph_trainer] Fix H100 CI: pre-install spmd_types (torch nightly hard-dep) ciflow/h100.8 Trigger H100.8 CI ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3588 opened Jun 9, 2026 by SherlockNoMad Contributor Loading…
10
[graph_trainer][aot_fx_trace][graph_pp] Enable fused edge FSDP graphs ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3585 opened Jun 9, 2026 by sanketpurandare Contributor Loading…
Add a router for multiple generators ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3583 opened Jun 9, 2026 by pzhan9 Contributor Loading…
35
[rl] PR2/N — AlphabetSort task; remove SumDigits ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3582 opened Jun 9, 2026 by felipemello1 Contributor Loading…
[MoE] Fix fp32 crash in token combine (scatter_add dtype mismatch) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3567 opened Jun 7, 2026 by ZYInSea • Draft
12
[graph trainer] add equivalent for activation_checkpoint.mode=none ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3564 opened Jun 6, 2026 by xmfan Member Loading…
1
[RL] Enable regional_inductor in FlexAttention ciflow/h100.8 Trigger H100.8 CI ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3563 opened Jun 6, 2026 by aditvenk Contributor Loading…
1
14
Add MinimalAsyncEP + offset aware swiglu kernels ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3561 opened Jun 5, 2026 by xmfan Member • Draft
54
[WIP] Add cudagraph mode, and HybridEP config for DSv3 16B ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3559 opened Jun 5, 2026 by xmfan Member • Draft
1
[not for land] graph trainer + mxfp8 composability ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3558 opened Jun 5, 2026 by vkuzo Contributor • Draft
[qwen3] Round-trip dense and MoE HF adapters ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3557 opened Jun 5, 2026 by ivy-zhou Loading…
2
[deepseek_v3] Complete MoE to_hf_map for shape-suffix expert weights ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3556 opened Jun 5, 2026 by ivy-zhou Loading…
1
[gpt_oss] Round-trip MoE expert weights through HF adapter ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3555 opened Jun 5, 2026 by ivy-zhou Loading…
1
[llama4] Round-trip MoE expert weights through HF adapter ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3554 opened Jun 5, 2026 by ivy-zhou Loading…
4
[tests] Add parameterized HuggingFace checkpoint round-trip test ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3553 opened Jun 5, 2026 by ivy-zhou Loading…
6
Enable Llama4 SPMD type integration ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3551 opened Jun 5, 2026 by pianpwk Contributor • Draft
Add SPMD sharding configs for MoE models ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3550 opened Jun 5, 2026 by pianpwk Contributor • Draft
[graph_trainer] Preserve DTensor shape in SimpleFSDP rewrap ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3549 opened Jun 5, 2026 by IvanKobzarev Contributor Loading…
3
ProTip! Filter pull requests by the default branch with base:main.