KV Cache int8 cooperate with Flash-attention2

[yhyu13]

HI,

Just wonder how well your implementation of KV Cache int8 PTQ works with flash-attentions's KV Cache partititioning strategy?

Do they all work together? Is there any statictics done on putting all optmizations togethers?

[zhyncs]

They can be used together.