Skip to content

Pull requests: swiss-ai/nanotron

New pull request New
8 Open 14 Closed
8 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Continued pretraining example
#23 opened Dec 4, 2024 by wendlerc Loading…
Fixed wrong lr initialization when loading checkpoints
#22 opened Nov 20, 2024 by AleHD Loading…
1
Validation step3
#21 opened Nov 19, 2024 by kylematoba Loading…
5
Tweak Pipeline Parallel layer split strategy
#20 opened Sep 3, 2024 by C-TC • Draft
Deleting cross attention between documents during pertaining
#16 opened Aug 22, 2024 by TJ-Solergibert Loading…
1
Adding SFT training
#14 opened Jul 30, 2024 by TJ-Solergibert Loading…
2 of 7 tasks
FA3 Tracking
#11 opened Jul 12, 2024 by TJ-Solergibert Loading…
MoEs in src/ and proper load balancing losses
#8 opened Jul 3, 2024 by haeggee Loading…
3
ProTip! Follow long discussions with comments:>50.