Skip to content

context : round n_tokens to next multiple of n_seqs when reserving#14140

Merged
compilade merged 1 commit intomasterfrom
compilade/fix-batch-reserve-rwkv
Jun 12, 2025
Merged

context : round n_tokens to next multiple of n_seqs when reserving#14140
compilade merged 1 commit intomasterfrom
compilade/fix-batch-reserve-rwkv

Commits

Commits on Jun 11, 2025