Search results

Outdated documentation after Transformers v5 dtype default behavior changed

Status: Open.

#5329 In huggingface/trl;

· brozjak2 opened on Mar 20, 2026

completion_only_loss

Status: Open.

#5324 In huggingface/trl;

· Alvar1000 opened on Mar 20, 2026

AttributeError: 'VLLMGeneration' object has no attribute 'vllm_client' when using generate_rollout_completions in vllm_mode="server" (Multi-GPU)

🐛 bugSomething isn't workingSomething isn't working

🚨 Important

Status: Open.

#5314 In huggingface/trl;

· SmartFive opened on Mar 19, 2026

vLLM weights are not synchronized with vllm_enable_sleep_mode=True

Status: Open.

#5312 In huggingface/trl;

· muupan opened on Mar 19, 2026

[Question] Do use_liger_gkd_loss breaks DDP gradient sync by unwrapping student model？

Status: Open.

#5282 In huggingface/trl;

· JeffLee1874 opened on Mar 13, 2026

qwen3.5-0.8 grpo trl(most recent version) is not working with vllm 0.17.0

🐛 bugSomething isn't workingSomething isn't working

🚨 Important

Status: Open.

#5269 In huggingface/trl;

· deter3 opened on Mar 10, 2026

[GOLD][vLLM] On-policy generation decodes prompts with skip_special_tokens=True (chat template stripped) — intentional?

Status: Open.

#5241 In huggingface/trl;

· siyan-zhao opened on Mar 7, 2026

Logging how vllm importance ratios are truncated/masked in GRPOTrainer

Status: Open.

#5231 In huggingface/trl;

· muupan opened on Mar 6, 2026

Integrate GTPO (Group-relative Trajectory-based Policy Optimization) as a new loss_type in GRPOTrainer

Status: Open.

#5226 In huggingface/trl;

· winstonsmith1897 opened on Mar 5, 2026

DPOTrainer ref adapter crashes with PEFT target_parameters (MoE models on Transformers 5.x)

Status: Open.

#5222 In huggingface/trl;

· pritmish opened on Mar 5, 2026

Recomputed tensor size does not match when using quantization + LoRA with the DPO Trainer with gradient checkpointing using deepspeed and accelerate

Status: Open.

#5217 In huggingface/trl;

· slhmath opened on Mar 4, 2026

ValueError: The following model_kwargs are not used by the model: ['mm_token_type_ids']

Status: Open.

Bug

#5216 In huggingface/trl;

· albertvillanova opened on Mar 4, 2026