Skip to content

Pull requests: huggingface/trl

New pull request New
119 Open 1,719 Closed
119 Open 1,719 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix peft_config type hint in experimental trainers
#5666 opened Apr 27, 2026 by albertvillanova Member Loading…
3
Fix missing PEFT availability check when passing peft_config to experimental trainers
#5665 opened Apr 27, 2026 by albertvillanova Member Loading…
6
Fix missing PEFT validation when passing peft_config to core trainers
#5664 opened Apr 27, 2026 by albertvillanova Member Loading…
7
Align KTO with DPO: Align PEFT handling
#5661 opened Apr 27, 2026 by albertvillanova Member Loading…
1
Fix token_type_ids requirement for gemma-3 models in GRPOTrainer
#5644 opened Apr 26, 2026 by robrui Loading…
3 of 6 tasks
1
DeepSeek v4
#5641 opened Apr 25, 2026 by qgallouedec Member • Draft
8 tasks
Fix spurious KL gradients for zero-std reward groups in GRPOTrainer
#5640 opened Apr 24, 2026 by robrui Loading…
3 of 6 tasks
1
3
Align tiny-Glm4MoeForCausalLM with GLM-4.5 reference config
#5638 opened Apr 24, 2026 by qgallouedec Member Loading…
8 tasks
6
Refactor tiny-model generation scripts
#5637 opened Apr 24, 2026 by qgallouedec Member Loading…
17
Add Cohere training chat template (#5471)
#5627 opened Apr 22, 2026 by dschulmeist Loading…
4 tasks done
8
feat: Add generation_kwargs support to LogCompletionsCallback and Wea…
#5625 opened Apr 22, 2026 by LhaseParth2610 Loading…
4 of 8 tasks
4
Upload testing suite for DistillationTrainer
#5615 opened Apr 21, 2026 by cmpatino Collaborator Loading…
3 of 8 tasks
9
Add LoRA support for AsyncGRPO
#5610 opened Apr 21, 2026 by jonahsamost Loading…
2 of 8 tasks
7
experimental: Self-Distillation Zero
#5609 opened Apr 20, 2026 by LeonEricsson Collaborator Loading…
1 of 8 tasks
3
support prefetch/prefetch_depth for async GRPO for ~5% speedups
#5602 opened Apr 20, 2026 by winglian Contributor Loading…
1 of 8 tasks
@AmineDiro
3
fix(distillation): reverse-KL server path NaN on variable completion length
#5594 opened Apr 19, 2026 by k1064190 Loading…
3 of 8 tasks
@kashif @cmpatino
12
Fix nested vocab_size for DistillationTrainer and GOLDTrainer
#5592 opened Apr 19, 2026 by Beichen-Ma Loading…
2 of 8 tasks
1
@cmpatino
1
feat: add TargetPO trainer
#5591 opened Apr 18, 2026 by JeanKaddour • Draft
4 of 8 tasks
5
Add training chat template for Qwen3-2507
#5574 opened Apr 16, 2026 by SwayamInSync Contributor Loading…
5
refactor: self distillation trainers (sdpo/sdft/...)
#5573 opened Apr 16, 2026 by LeonEricsson Collaborator Loading…
2 of 8 tasks
17
Fix empty-target self-distillation loss to stay connected to model graph
#5572 opened Apr 16, 2026 by walawalagoose Loading…
3 of 8 tasks
Improve BrowserGym examples for latest OpenEnv version
#5568 opened Apr 16, 2026 by sergiopaniego Member Loading…
8 tasks
7
Set _tokenizer attribute in experimental trainers
#5566 opened Apr 16, 2026 by albertvillanova Member Loading…
8
Revert VLM support in parse_response
#5561 opened Apr 15, 2026 by qgallouedec Member • Draft
5
Accept processor in get_training_chat_template
#5560 opened Apr 15, 2026 by qgallouedec Member Loading…
7
ProTip! Add no:assignee to see everything that’s not assigned.