Skip to content

Pull requests: pytorch/torchtune

New pull request New
64 Open 1,395 Closed
64 Open 1,395 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add torchdata Parallel Packer for faster startup CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2364 opened Feb 7, 2025 by andrewkho Loading…
13 tasks
1
readme updates for full DPO distributed recipe CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2363 opened Feb 7, 2025 by ebsmothers Loading…
1
Resume from checkpoint with distributed optimizer-in-backward repro CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2359 opened Feb 7, 2025 by ebsmothers • Draft
1
Add mistral small CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2358 opened Feb 7, 2025 by AndrewMead10 Loading…
4 of 13 tasks
1
Add max-autotune try/except if flex attn breaks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2357 opened Feb 7, 2025 by felipemello1 Loading…
1 of 4 tasks
11
Generic classifier builder CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2356 opened Feb 7, 2025 by SalmanMohammadi • Draft
4
[WIP] Support Continual Pretraining Multi Dataset using Streaming CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2355 opened Feb 6, 2025 by mostafaelhoushi • Draft
2 of 13 tasks
7
HF tokenizers: initial base tokenizer support CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2350 opened Feb 5, 2025 by ebsmothers Loading…
1
12
Rework recipes section of README and simplify models ref CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2349 opened Feb 5, 2025 by joecummings Loading…
4
Traj dpo
#2343 opened Feb 4, 2025 by Vattikondadheeraj Loading…
13 tasks
2
TP + FSDP distributed training (full finetuning) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2330 opened Feb 2, 2025 by acisseJZhong Loading…
2 of 13 tasks
10
[WIP] Add distributed inference for llama3.2 vision CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2328 opened Feb 1, 2025 by acisseJZhong Loading…
13 tasks
4
try fix a bug for symbolic check CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2327 opened Feb 1, 2025 by ywq880611 Loading…
2 of 13 tasks
3
[Very WiP] R1-Style distributed GRPO CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2326 opened Feb 1, 2025 by RedTachyon Loading…
1 of 13 tasks
68
Refactor validate missing for LoRA + deprecate param utility CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2321 opened Jan 31, 2025 by RdoubleA Loading…
7 of 13 tasks
2
[WIP] 2D parallelism for training CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2318 opened Jan 29, 2025 by joecummings • Draft
3
Text-to-Image Dataset and Flux Transform CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2311 opened Jan 29, 2025 by calvinpelletier Loading…
5 tasks done
1
Flux Model CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2302 opened Jan 27, 2025 by calvinpelletier Loading…
7 tasks done
17
Custom DPO losses support CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2292 opened Jan 22, 2025 by krammnic Loading…
3 of 13 tasks
8
Add masking strategies to message transforms CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2284 opened Jan 20, 2025 by supreethmanyam Loading…
7 of 13 tasks
13
[EZ] Pass seed to data sampler. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2266 opened Jan 14, 2025 by EugenHotaj Loading…
4 of 13 tasks
13
Update QuantizationRecipe to use checkpointer.save_checkpoint CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2257 opened Jan 13, 2025 by Ankur-singh Loading…
5 of 13 tasks
13
Adds validation loss to LoRA fine tune single device CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2238 opened Jan 8, 2025 by MaxFrax Loading…
5 of 13 tasks
29
[WIP] Add 2D Parallelism (FSDP + Tensor Parallel) LoRA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2204 opened Dec 24, 2024 by matthew-hippocratic Loading…
7 tasks done
9
[RFC] Online and offline adaptive batching in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2199 opened Dec 22, 2024 by krammnic Loading…
3
ProTip! Mix and match filters to narrow down what you’re looking for.