Skip to content

Issues: pytorch/torchtitan

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

47 Open 136 Closed
47 Open 136 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Is autocast needed with FSDP2? question Further information is requested
#700 opened Nov 25, 2024 by garrett361
Vote on new features in Discussions
#694 opened Nov 23, 2024 by tianyu-l
2
[rfc] torchtitan release practices release_blocking Issues that are blocking the milestone / release completion
#688 opened Nov 22, 2024 by tianyu-l torchtitan v1.0.0 release
torch.compile(sync_float8_amax_and_scale_history) not working with triton latest main bug Something isn't working
#681 opened Nov 19, 2024 by goldhuang
1
[Parallelism] Implement vocabulary parallelism enhancement New feature or request
#680 opened Nov 15, 2024 by casper-hansen
1
Any suggestion for Llama-3.1-70b(128k seq len) deploy mesh with torchtian? enhancement New feature or request question Further information is requested
#678 opened Nov 15, 2024 by medivh-xp
8
Fine-Tuning Llama Model with Large Context and Customized Dataset Using Torchtitan enhancement New feature or request question Further information is requested
#677 opened Nov 14, 2024 by Amerehei
7
Very low wps with H200 Gpus question Further information is requested
#676 opened Nov 13, 2024 by aniltrkkn
6
[Config] Make the checkpoint step configurable. enhancement New feature or request good first issue Good for newcomers
#662 opened Oct 30, 2024 by casper-hansen
3
Questions about FSDP2 support and memory usage. question Further information is requested
#658 opened Oct 29, 2024 by tangjiasheng
6
meta device issue with float8 delayed scale bug Something isn't working
#654 opened Oct 25, 2024 by weifengpy torchtitan v1.0.0 release
8
torch.distributed.breakpoint(rank=1) hangs because of --local-ranks-filter 0 documentation Improvements or additions to documentation
#652 opened Oct 25, 2024 by weifengpy
[Multimodal] Adding OBELICS DataLoader enhancement New feature or request
#650 opened Oct 24, 2024 by TJ-Solergibert
1
8
Convergence testing best practices documentation Improvements or additions to documentation
#648 opened Oct 22, 2024 by gnadathur torchtitan v1.0.0 release
1
@tianyu-l
5
[Config] Make FSDP reshard_after_forward: bool configurable enhancement New feature or request
#644 opened Oct 22, 2024 by awgu
What is the expected inference steps after I apply torchao in training? question Further information is requested
#638 opened Oct 21, 2024 by goldhuang
3
add H100 in CI better_engineering Repo code quality improvements integration test Adding integration tests
#632 opened Oct 18, 2024 by tianyu-l
1
create a note on torchtitan official release documentation Improvements or additions to documentation release_blocking Issues that are blocking the milestone / release completion
#631 opened Oct 18, 2024 by tianyu-l torchtitan v1.0.0 release
@XilunWu @H-Huang
@lessw2020 @tianyu-l
Non-DP runs default to float32 precision enhancement New feature or request
#630 opened Oct 18, 2024 by carmocca
1
1
add Llama 3.2 support enhancement New feature or request
#625 opened Oct 18, 2024 by tianyu-l
@fduwjj
3
[Triton] Implement Liger Kernels enhancement New feature or request
#623 opened Oct 17, 2024 by casper-hansen
1
Ability to train based on epoch enhancement New feature or request good first issue Good for newcomers
#613 opened Oct 13, 2024 by abatilo
1
[Compile] Understand why FSDP2 saves both SDPA out and wo in for bwd question Further information is requested
#610 opened Oct 11, 2024 by awgu
Granular layer selection during Pipeline Parallelism enhancement New feature or request
#598 opened Oct 3, 2024 by bhuvan777
2
Support INT8 mixed-precision training from torchao? enhancement New feature or request
#578 opened Sep 14, 2024 by gau-nernst
8
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.