Implement multi-batch support for v2, v3, and r1 models with backend type configured as ktransformers.#1428
Open
jiafei96 wants to merge 1 commit intokvcache-ai:mainfrom
Open
Implement multi-batch support for v2, v3, and r1 models with backend type configured as ktransformers.#1428jiafei96 wants to merge 1 commit intokvcache-ai:mainfrom
jiafei96 wants to merge 1 commit intokvcache-ai:mainfrom
