fix edge case for qwen3 data processing#626

Merged

mergify[bot] merged 3 commits intoinstructlab:mainfrom

RobotSail:fix-data-processing

Jun 30, 2025

Commits on Jun 30, 2025

enable the training repo to handle reasoning traces within `reasoning_content` fields

RobotSail
authored and
cdoern
committed
robust data processing logic + testing

RobotSail
authored and
cdoern
committed
add tests to validate that the behavior of `unmask: true` and `unmask: false` on samples functions as expected

RobotSail
authored and
cdoern
committed