Yield per-document RoPE position ids from dataset#2560

Merged

joecummings merged 8 commits intopytorch:mainfrom

joecummings:fix-pos-id

Mar 19, 2026

Commits on Mar 18, 2026

Yield per-document RoPE position IDs from HuggingFaceTextDataset
joecummings
committed
fix: drop positions from extra_inputs in validator to prevent duplicate kwarg with CP+PP
joecummings
committed
fix: correct misleading TODO comments about positions guard
joecummings
committed
fix: wrap per-document RoPE positions at seq_len to prevent OOB gather
joecummings
committed
fix: wrap positions as DTensor in RoPE and warn on missing position_buffer
joecummings
committed
fix: derive positions DTensor placements from x instead of freqs_cis
joecummings
committed
Merge remote-tracking branch 'upstream/main' into fix-pos-id
joecummings
committed
fix: derive positions DTensor placements from x instead of freqs_cis
joecummings
committed