Skip to content

Issues: pytorch/torchtune

v0.4.0 release tracker
#1747 opened Oct 2, 2024 by joecummings
Open 3
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

200 Open 476 Closed
200 Open 476 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question about custom Fine-tuning
#1927 opened Oct 30, 2024 by sorobedio
investigate compile flag in flex attention better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1926 opened Oct 30, 2024 by felipemello1
How to finetune custom models?
#1925 opened Oct 30, 2024 by nam1410
2
Make ModelTokenizer a Transform better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1922 opened Oct 30, 2024 by RdoubleA
[docs] Fix custom message transform example community help wanted We would love the community's help completing this issue documentation Improvements or additions to documentation
#1919 opened Oct 29, 2024 by RdoubleA
Rename knowledge distillation recipe to lora_knowledge_distillation_single_device better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1906 opened Oct 25, 2024 by SalmanMohammadi
@SalmanMohammadi
Support for activation offloading pre-fetching? question Further information is requested
#1905 opened Oct 25, 2024 by shuy98
@joecummings @janeyx99
1
[bug] DoRA is broken bug Something isn't working
#1903 opened Oct 25, 2024 by ebsmothers
1
[Feature] Support additional trainable layers during LoRA fine-tuning enhancement New feature or request
#1901 opened Oct 24, 2024 by ebsmothers
4
Removing extra checks for logging memory in recipes better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue
#1900 opened Oct 24, 2024 by SalmanMohammadi
@SalmanMohammadi
[Cleanup] Delete FSDP1 code community help wanted We would love the community's help completing this issue
#1897 opened Oct 24, 2024 by ebsmothers
8 tasks
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
8 tasks
Custom reference model for DPO recipes
#1888 opened Oct 23, 2024 by krammnic
Better testing for eval recipe: add test for generation and log likelihood tasks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873 opened Oct 20, 2024 by SalmanMohammadi
@SalmanMohammadi
Mask construction & attention dispatch issues and possible ideas to allow for more models discussion Start a discussion
#1870 opened Oct 19, 2024 by mirceamironenco
"Get Started" Documentation Doesn't Work bug Something isn't working documentation Improvements or additions to documentation
#1869 opened Oct 19, 2024 by lhl
@joecummings
1
OffloadActivations(use_streams=True) producing NaN gradients: a tensor deletion data race bug Something isn't working
#1867 opened Oct 19, 2024 by ringohoffman
1
9
Separate ToMessages transforms for text+image better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs discussion Start a discussion
#1862 opened Oct 17, 2024 by RdoubleA
6
Remove PyTorch 2.5.0 checks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#1861 opened Oct 17, 2024 by RdoubleA
7 tasks
@JP-sDEV
3
using Torchtune to teach LLMs a new language question Further information is requested
#1859 opened Oct 17, 2024 by almugabo
3
MM dataset docs nits documentation Improvements or additions to documentation
#1858 opened Oct 17, 2024 by SalmanMohammadi
@pbontrager
CUDA error with <bitsandbytes.optim.PagedAdamW> optimzier
#1856 opened Oct 17, 2024 by shawnricecake
2
[RFC] Kaggle Model Hub Integration for Torchtune rfc Request for comments
#1852 opened Oct 16, 2024 by KeijiBranshi
@joecummings
17
General tracker of RLHF methods addition community help wanted We would love the community's help completing this issue enhancement New feature or request
#1850 opened Oct 16, 2024 by krammnic
2 of 8 tasks
5
Removing cacheing related APIs from attention layers better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1848 opened Oct 16, 2024 by SalmanMohammadi
@SalmanMohammadi
1
ProTip! Updated in the last three days: updated:>2024-10-27.