Skip to content

Issues: pytorch/torchtune

v0.4.0 release tracker
#1747 opened Oct 2, 2024 by joecummings
Open 3
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
52 Open 1,180 Closed
52 Open 1,180 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add support for QAT + LoRA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1931 opened Oct 31, 2024 by andrewor14 • Draft
2
Migrate state dict API to DSD CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1930 opened Oct 30, 2024 by mori360 • Draft
13 tasks
1
[draft] torchdata integration CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1929 opened Oct 30, 2024 by andrewkho Loading…
13 tasks
8
Restore backward after each batch for grad accum CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1917 opened Oct 29, 2024 by ebsmothers Loading…
21
Fix offloading saved tensor interaction with checkpointing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1913 opened Oct 28, 2024 by janeyx99 Loading…
2 of 13 tasks
1
1
Fix lora single device fine tune checkpoint saving & nan loss when use_dora=True CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1909 opened Oct 27, 2024 by mirceamironenco Loading…
5 of 13 tasks
1
10
Add prompt completion e2e code CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1907 opened Oct 25, 2024 by qqlabs • Draft
13 tasks
2
[RFC] Early fusion multimodal models CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#1904 opened Oct 25, 2024 by RdoubleA Loading…
11
[RFC] MOE design in Torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#1902 opened Oct 24, 2024 by acisseJZhong Loading…
15
[WIP] MM Eval tests CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1887 opened Oct 23, 2024 by SalmanMohammadi • Draft
13 tasks
1
fix dora tune_to_peft_adapter_weights CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1884 opened Oct 23, 2024 by huiwy Loading…
1 of 13 tasks
6
chore: remove PyTorch 2.5.0 checks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1877 opened Oct 21, 2024 by JP-sDEV Loading…
3 of 12 tasks
7
Make tokenize tests readable CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1868 opened Oct 19, 2024 by krammnic Loading…
3 of 13 tasks
28
PTQ for generate_v2 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1866 opened Oct 18, 2024 by joecummings Loading…
8 of 13 tasks
1
31
[WIP] Add KTOLoss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1864 opened Oct 18, 2024 by krammnic Loading…
6 of 13 tasks
33
Qwen2.5 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1863 opened Oct 18, 2024 by calvinpelletier Loading…
8 of 11 tasks
79
Update QAT: add grad clipping, torch.compile, collate fn CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1854 opened Oct 16, 2024 by andrewor14 Loading…
3
feat: add gemma2b variants CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1835 opened Oct 15, 2024 by Optimox Loading…
2 of 13 tasks
@felipemello1
68
Add Ascend NPU as a backend CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1826 opened Oct 14, 2024 by noemotiovon Loading…
51
Aoti CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1753 opened Oct 4, 2024 by larryliu0820 • Draft
13 tasks
4
Assert LLama Vision Image size divides by 14 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1745 opened Oct 2, 2024 by pbontrager Loading…
7
[WIP] Config Continous Integration (CCI) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1717 opened Sep 30, 2024 by SalmanMohammadi Loading…
1 of 13 tasks
18
[WIP] Quick Llama3.2 e2e tutorial CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1685 opened Sep 25, 2024 by RdoubleA Loading…
13 tasks
2
[WIP] Add tests for lora finetune single device act offload CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1604 opened Sep 16, 2024 by janeyx99 • Draft
1
[DRAFT] Factor out core SDPA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1561 opened Sep 12, 2024 by dvorjackz • Draft
3 of 7 tasks
13
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.