-
Notifications
You must be signed in to change notification settings - Fork 414
Issues: pytorch/torchtune
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
investigate compile flag in flex attention
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1926
opened Oct 30, 2024 by
felipemello1
Make Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
ModelTokenizer
a Transform
better engineering
#1922
opened Oct 30, 2024 by
RdoubleA
[docs] Fix custom message transform example
community help wanted
We would love the community's help completing this issue
documentation
Improvements or additions to documentation
#1919
opened Oct 29, 2024 by
RdoubleA
Rename knowledge distillation recipe to Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
lora_knowledge_distillation_single_device
better engineering
#1906
opened Oct 25, 2024 by
SalmanMohammadi
Support for activation offloading pre-fetching?
question
Further information is requested
#1905
opened Oct 25, 2024 by
shuy98
[Feature] Support additional trainable layers during LoRA fine-tuning
enhancement
New feature or request
#1901
opened Oct 24, 2024 by
ebsmothers
Removing extra checks for logging memory in recipes
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1900
opened Oct 24, 2024 by
SalmanMohammadi
[Cleanup] Delete FSDP1 code
community help wanted
We would love the community's help completing this issue
#1897
opened Oct 24, 2024 by
ebsmothers
8 tasks
Better testing for eval recipe: add test for generation and log likelihood tasks
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873
opened Oct 20, 2024 by
SalmanMohammadi
Mask construction & attention dispatch issues and possible ideas to allow for more models
discussion
Start a discussion
#1870
opened Oct 19, 2024 by
mirceamironenco
"Get Started" Documentation Doesn't Work
bug
Something isn't working
documentation
Improvements or additions to documentation
#1869
opened Oct 19, 2024 by
lhl
OffloadActivations(use_streams=True)
producing NaN gradients: a tensor deletion data race
bug
#1867
opened Oct 19, 2024 by
ringohoffman
Separate Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
discussion
Start a discussion
ToMessages
transforms for text+image
better engineering
#1862
opened Oct 17, 2024 by
RdoubleA
Remove PyTorch 2.5.0 checks
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
good first issue
Good for newcomers
#1861
opened Oct 17, 2024 by
RdoubleA
7 tasks
using Torchtune to teach LLMs a new language
question
Further information is requested
#1859
opened Oct 17, 2024 by
almugabo
MM dataset docs nits
documentation
Improvements or additions to documentation
#1858
opened Oct 17, 2024 by
SalmanMohammadi
CUDA error with <bitsandbytes.optim.PagedAdamW> optimzier
#1856
opened Oct 17, 2024 by
shawnricecake
[RFC] Kaggle Model Hub Integration for Torchtune
rfc
Request for comments
#1852
opened Oct 16, 2024 by
KeijiBranshi
General tracker of RLHF methods addition
community help wanted
We would love the community's help completing this issue
enhancement
New feature or request
#1850
opened Oct 16, 2024 by
krammnic
2 of 8 tasks
Removing cacheing related APIs from attention layers
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1848
opened Oct 16, 2024 by
SalmanMohammadi
Previous Next
ProTip!
Updated in the last three days: updated:>2024-10-27.