[None][feat] Support using FlexKV as anothor KV Cache Offloading option.#9698

Open

axxx03 wants to merge 12 commits intoNVIDIA:mainfrom

axxx03:feature/support_flexkv

Commits on Jan 8, 2026

1. add flexkv support

axxx03
authored and
Shixiaowei02
committed
fix waiting for flexkv_manager

axxx03
authored and
Shixiaowei02
committed
fix no free slots error

axxx03
authored and
Shixiaowei02
committed
Add ut for connector_num_matched_tokens

axxx03
authored and
Shixiaowei02
committed
fix according to reviewer

axxx03
authored and
Shixiaowei02
committed
tmp fix

axxx03
authored and
Shixiaowei02
committed
rename wait_for_ready

axxx03
authored and
Shixiaowei02
committed
fix free_slot_only

axxx03
authored and
Shixiaowei02
committed
remove NumConnectorMatchedToken

axxx03
authored and
Shixiaowei02
committed
fix

axxx03
authored and
Shixiaowei02
committed
remove tests

axxx03
authored and
Shixiaowei02
committed

Commits on Jan 9, 2026

revert unrelevant change
axxx03
committed