fix: Fix Guided Decoding Crashes and State Corruption Issues#4167

Closed

windreamer wants to merge 5 commits intoInternLM:mainfrom

windreamer:fix_guided_decoding_tp

Commits on Nov 28, 2025

fix: fix guided decoding state corruption in turbomind when tp>1
windreamer
committed

Commits on Dec 4, 2025

fix: fix a potential synchronize bug when update state
windreamer
committed

Commits on Dec 10, 2025

fix: fix initialized bitmask buffer when mixing guided requests and non-guided requests
windreamer
committed
fix: add clear_grammar to remove grammar from reused model_request
windreamer
committed

Commits on Dec 11, 2025

test: add mixing guided and non-guided tests
windreamer
committed