Skip to content

Issues: pytorch/torchtitan

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

65 Open 100 Closed
65 Open 100 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

meta device issue with float8 delayed scale bug Something isn't working
#654 opened Oct 25, 2024 by weifengpy
5
torch.distributed.breakpoint(rank=1) hangs because of --local-ranks-filter 0 bug Something isn't working
#652 opened Oct 25, 2024 by weifengpy
FP8Linear saves new parameters in ckpt and I cannot load the saved ckpt bug Something isn't working
#651 opened Oct 24, 2024 by goldhuang
5
[Multimodal] Adding OBELICS DataLoader
#650 opened Oct 24, 2024 by TJ-Solergibert
4
Convergence testing best practices
#648 opened Oct 22, 2024 by gnadathur torchtitan release 1.0
4
[Config] Make FSDP reshard_after_forward: bool configurable enhancement New feature or request
#644 opened Oct 22, 2024 by awgu
What is the expected inference steps after I apply torchao in training? question Further information is requested
#638 opened Oct 21, 2024 by goldhuang
3
DDP + Pipeline parallelism question Further information is requested
#636 opened Oct 20, 2024 by prathameshtd
3
HSDP IB Issues bug Something isn't working
#633 opened Oct 18, 2024 by karan-dalal
5
add H100 in CI better_engineering Repo code quality improvements integration test Adding integration tests
#632 opened Oct 18, 2024 by tianyu-l torchtitan release 1.0
create a note on torchtitan official release documentation Improvements or additions to documentation release_blocking Issues that are blocking the milestone / release completion
#631 opened Oct 18, 2024 by tianyu-l torchtitan release 1.0
@lessw2020 @tianyu-l
Non-DP runs default to float32 precision enhancement New feature or request
#630 opened Oct 18, 2024 by carmocca
1
add Llama 3.2 support
#625 opened Oct 18, 2024 by tianyu-l torchtitan release 1.0
@fduwjj
3
[Triton] Implement Liger Kernels enhancement New feature or request
#623 opened Oct 17, 2024 by casper-hansen
Is there way to offload training memory to DRAM (using FSDP2?) for training Llama3-8B with torchtitan? question Further information is requested
#620 opened Oct 15, 2024 by 0781532
2
9
Question about torch.compile has better throughput with 128-GPUs than 8-GPUs question Further information is requested
#619 opened Oct 15, 2024 by dz1iang
@tianyu-l
3
redundant checks in checkpoint.py better_engineering Repo code quality improvements good first issue Good for newcomers
#617 opened Oct 14, 2024 by eminorhan torchtitan release 1.0
Ability to train based on epoch enhancement New feature or request good first issue Good for newcomers
#613 opened Oct 13, 2024 by abatilo
1
[Compile] Understand why FSDP2 saves both SDPA out and wo in for bwd question Further information is requested
#610 opened Oct 11, 2024 by awgu
why is xformers not used for attention computation? question Further information is requested
#608 opened Oct 9, 2024 by jason718
4
Granular layer selection during Pipeline Parallelism question Further information is requested
#598 opened Oct 3, 2024 by bhuvan777
2
Gradient norm clipping with pipeline parallelism (PP) bug Something isn't working release_blocking Issues that are blocking the milestone / release completion
#596 opened Oct 1, 2024 by zijian-hu torchtitan release 1.0
@H-Huang
9
Support Gemma2 in torchtitan enhancement New feature or request
#594 opened Oct 1, 2024 by pansershrek
3
reproducable numerics for loss, weights and gradients for single node (8 GPUs) enhancement New feature or request
#593 opened Oct 1, 2024 by weifengpy
1
2
Inference with the checkpoint enhancement New feature or request
#586 opened Sep 23, 2024 by mathmax12
3
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.