-
Notifications
You must be signed in to change notification settings - Fork 411
Issues: pytorch/torchtune
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Rename knowledge distillation recipe to Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
lora_knowledge_distillation_single_device
better engineering
#1906
opened Oct 25, 2024 by
SalmanMohammadi
Support for activation offloading pre-fetching?
question
Further information is requested
#1905
opened Oct 25, 2024 by
shuy98
[Feature] Support additional trainable layers during LoRA fine-tuning
enhancement
New feature or request
#1901
opened Oct 24, 2024 by
ebsmothers
Removing extra checks for logging memory in recipes
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1900
opened Oct 24, 2024 by
SalmanMohammadi
[Cleanup] Delete FSDP1 code
community help wanted
We would love the community's help completing this issue
#1897
opened Oct 24, 2024 by
ebsmothers
8 tasks
[BUG] Llama3.2 vision eleuther eval recipe Something isn't working
high-priority
RuntimeError: stack expects each tensor to be equal size, but got [259, 6404]
bug
#1874
opened Oct 20, 2024 by
SalmanMohammadi
Better testing for eval recipe: add test for generation and log likelihood tasks
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873
opened Oct 20, 2024 by
SalmanMohammadi
Mask construction & attention dispatch issues and possible ideas to allow for more models
discussion
Start a discussion
#1870
opened Oct 19, 2024 by
mirceamironenco
"Get Started" Documentation Doesn't Work
bug
Something isn't working
documentation
Improvements or additions to documentation
#1869
opened Oct 19, 2024 by
lhl
OffloadActivations(use_streams=True)
producing NaN gradients: a tensor deletion data race
bug
#1867
opened Oct 19, 2024 by
ringohoffman
Separate Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
discussion
Start a discussion
ToMessages
transforms for text+image
better engineering
#1862
opened Oct 17, 2024 by
RdoubleA
Remove PyTorch 2.5.0 checks
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
good first issue
Good for newcomers
#1861
opened Oct 17, 2024 by
RdoubleA
7 tasks
using Torchtune to teach LLMs a new language
question
Further information is requested
#1859
opened Oct 17, 2024 by
almugabo
MM dataset docs nits
documentation
Improvements or additions to documentation
#1858
opened Oct 17, 2024 by
SalmanMohammadi
CUDA error with <bitsandbytes.optim.PagedAdamW> optimzier
#1856
opened Oct 17, 2024 by
shawnricecake
[RFC] Kaggle Model Hub Integration for Torchtune
rfc
Request for comments
#1852
opened Oct 16, 2024 by
KeijiBranshi
General tracker of RLHF methods addition
community help wanted
We would love the community's help completing this issue
enhancement
New feature or request
#1850
opened Oct 16, 2024 by
krammnic
2 of 8 tasks
Delete Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
chat_formats.py
and instruct_formats.py
better engineering
#1849
opened Oct 16, 2024 by
joecummings
Removing cacheing related APIs from attention layers
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1848
opened Oct 16, 2024 by
SalmanMohammadi
TextCompletionDataset load_dataset_kwargs should point to Hugging Face documentation
documentation
Improvements or additions to documentation
#1846
opened Oct 15, 2024 by
joecummings
Fix contradictory information in InstructDataset and PromptTemplate
documentation
Improvements or additions to documentation
#1844
opened Oct 15, 2024 by
joecummings
Point Github link at top right of documentation to pytorch/torchtune
documentation
Improvements or additions to documentation
#1843
opened Oct 15, 2024 by
joecummings
Previous Next
ProTip!
Follow long discussions with comments:>50.