feat: kv fp8 quant calibration for fa3 and flashinfer#935

Merged

hiworldwzj merged 7 commits intomainfrom

Jul 14, 2025

Commits on Jul 10, 2025

feat: kv fp8 quant calibration for fa3 and flashinfer
niushengxiao
committed
fix: replace single float with two floats for per tensor quant
niushengxiao
committed
opt: optimatize fp8kv performance
niushengxiao
committed
feat: update calibration config files
niushengxiao
committed
feat: kv fp8 quant calibration for fa3
niushengxiao
committed
feat: change mode name to offline_calibration_fp8kv
niushengxiao
committed

Commits on Jul 14, 2025

feat: add pre tensor fp8 kv quant for flashinfer
niushengxiao
committed