Skip to content

Issues: pytorch/torchtune

v0.4.0 release tracker
#1747 opened Oct 2, 2024 by joecummings
Open 3
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

214 Open 456 Closed
214 Open 456 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Rename knowledge distillation recipe to lora_knowledge_distillation_single_device better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1906 opened Oct 25, 2024 by SalmanMohammadi
@SalmanMohammadi
Support for activation offloading pre-fetching? question Further information is requested
#1905 opened Oct 25, 2024 by shuy98
@joecummings @janeyx99
1
[bug] DoRA is broken bug Something isn't working
#1903 opened Oct 25, 2024 by ebsmothers
[Feature] Support additional trainable layers during LoRA fine-tuning enhancement New feature or request
#1901 opened Oct 24, 2024 by ebsmothers
4
Removing extra checks for logging memory in recipes better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue
#1900 opened Oct 24, 2024 by SalmanMohammadi
@SalmanMohammadi
[Cleanup] Delete FSDP1 code community help wanted We would love the community's help completing this issue
#1897 opened Oct 24, 2024 by ebsmothers
8 tasks
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
6 tasks
Custom reference model for DPO recipes
#1888 opened Oct 23, 2024 by krammnic
[BUG] Llama3.2 vision eleuther eval recipe RuntimeError: stack expects each tensor to be equal size, but got [259, 6404] bug Something isn't working high-priority
#1874 opened Oct 20, 2024 by SalmanMohammadi
@pbontrager
2
Better testing for eval recipe: add test for generation and log likelihood tasks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873 opened Oct 20, 2024 by SalmanMohammadi
@SalmanMohammadi
Mask construction & attention dispatch issues and possible ideas to allow for more models discussion Start a discussion
#1870 opened Oct 19, 2024 by mirceamironenco
"Get Started" Documentation Doesn't Work bug Something isn't working documentation Improvements or additions to documentation
#1869 opened Oct 19, 2024 by lhl
@joecummings
1
OffloadActivations(use_streams=True) producing NaN gradients: a tensor deletion data race bug Something isn't working
#1867 opened Oct 19, 2024 by ringohoffman
9
Separate ToMessages transforms for text+image better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs discussion Start a discussion
#1862 opened Oct 17, 2024 by RdoubleA
6
Remove PyTorch 2.5.0 checks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#1861 opened Oct 17, 2024 by RdoubleA
7 tasks
@JP-sDEV
3
using Torchtune to teach LLMs a new language question Further information is requested
#1859 opened Oct 17, 2024 by almugabo
3
MM dataset docs nits documentation Improvements or additions to documentation
#1858 opened Oct 17, 2024 by SalmanMohammadi
@pbontrager
CUDA error with <bitsandbytes.optim.PagedAdamW> optimzier
#1856 opened Oct 17, 2024 by shawnricecake
2
[RFC] Kaggle Model Hub Integration for Torchtune rfc Request for comments
#1852 opened Oct 16, 2024 by KeijiBranshi
@joecummings
10
General tracker of RLHF methods addition community help wanted We would love the community's help completing this issue enhancement New feature or request
#1850 opened Oct 16, 2024 by krammnic
2 of 8 tasks
4
Delete chat_formats.py and instruct_formats.py better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1849 opened Oct 16, 2024 by joecummings
1
@RdoubleA
Removing cacheing related APIs from attention layers better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1848 opened Oct 16, 2024 by SalmanMohammadi
@SalmanMohammadi
1
TextCompletionDataset load_dataset_kwargs should point to Hugging Face documentation documentation Improvements or additions to documentation
#1846 opened Oct 15, 2024 by joecummings
@felipemello1
Fix contradictory information in InstructDataset and PromptTemplate documentation Improvements or additions to documentation
#1844 opened Oct 15, 2024 by joecummings
@joecummings
Point Github link at top right of documentation to pytorch/torchtune documentation Improvements or additions to documentation
#1843 opened Oct 15, 2024 by joecummings
@ebsmothers
ProTip! Follow long discussions with comments:>50.