avoid copying new_tokens to cpu#118

Open

suyoggupta wants to merge 1 commit intofeat/ad-2025-07-22from

Commits on Jul 27, 2025

avoid gpu->cpu transfer when using overlap scheduler
suyoggupta
committed