Skip to content

Issues: pytorch/torchtune

v0.6.0 tracker
#2232 opened Jan 6, 2025 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

291 Open 642 Closed
291 Open 642 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error in knowledge_distillation_distributed due to vocab size mismatch
#2502 opened Mar 14, 2025 by zxl0810
Can we decouple the data preprocssing/tokenization step from the fine-tuning phase?
#2497 opened Mar 13, 2025 by Electronic-Waste
cross-attention in llama 3.2 vision has is_causal=False
#2493 opened Mar 13, 2025 by mmehdig
3
Consolidate tok_encode logic between _LLMEvalWrapper and _VLMEvalWrapper
#2488 opened Mar 12, 2025 by pbontrager
@joecummings
1
Gemma3
#2484 opened Mar 12, 2025 by krammnic
recursive_reshard
#2483 opened Mar 12, 2025 by caiqi
Add add_end_token to the Qwen Models bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2481 opened Mar 11, 2025 by pbontrager
Add add_end_token to Phi tokenizers bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2480 opened Mar 11, 2025 by pbontrager
Add add_end_token to Mistral tokenizer bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2479 opened Mar 11, 2025 by pbontrager
Add add_end_token to the Gemma Tokenizer bug Something isn't working community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2478 opened Mar 11, 2025 by pbontrager
MPS memory leak bug Something isn't working triage review This issue should be discussed in weekly review
#2473 opened Mar 10, 2025 by SalmanMohammadi
2
Option to clip logprobs rlhf.get_batch_log_probs
#2470 opened Mar 9, 2025 by krammnic
4
Chunked GRPO loss enhancement New feature or request
#2469 opened Mar 9, 2025 by SalmanMohammadi
@SalmanMohammadi
1
Chunked DPO loss enhancement New feature or request
#2468 opened Mar 9, 2025 by SalmanMohammadi
@SalmanMohammadi
3
Will support multi-turn conversations? enhancement New feature or request triage review This issue should be discussed in weekly review
#2463 opened Mar 6, 2025 by dz1iang
3
No chat template in evaluation community help wanted We would love the community's help completing this issue enhancement New feature or request
#2459 opened Mar 5, 2025 by xueyan-lii
3
Bring in DSV3 from torchtitan enhancement New feature or request
#2457 opened Mar 4, 2025 by EugenHotaj
3
[Question]: activation offload won't work for torch version < 2.5 discussion Start a discussion enhancement New feature or request
#2456 opened Mar 4, 2025 by Irvingwangjr
10
torchtune dry-run feature request community help wanted We would love the community's help completing this issue enhancement New feature or request triage review This issue should be discussed in weekly review
#2453 opened Mar 3, 2025 by agunapal
6
Value Recomputation Shape Mismatch For Tensor Parallelism bug Something isn't working distributed Anything related to distributed env (multi-GPU, multi-node)
#2451 opened Mar 2, 2025 by TAplutos
@joecummings @janeyx99
6
How to run a multi-node, multi-GPU training in a Ray cluster? discussion Start a discussion distributed Anything related to distributed env (multi-GPU, multi-node)
#2450 opened Mar 2, 2025 by Hambaobao
@joecummings
7
Qwen2.5-VL support planned?
#2448 opened Mar 1, 2025 by paras-genmo
1
Add StatefulDataloader to remainder of recipes community help wanted We would love the community's help completing this issue enhancement New feature or request high-priority
#2439 opened Feb 26, 2025 by joecummings
8 tasks
3
Add support for Llama-Guard discussion Start a discussion triaged This issue has been assigned an owner and appropriate label
#2434 opened Feb 25, 2025 by agunapal
@ebsmothers
5
Feature Request: Fix Untrained Tokens for Llama3 Base enhancement New feature or request
#2429 opened Feb 24, 2025 by maxwellreynolds
@joecummings
ProTip! Exclude everything labeled bug with -label:bug.