Commit c5de4a5

committed

add group8_int8kv_flashdecoding_diverse_stage2

1 parent 9c939db commit c5de4a5Copy full SHA for c5de4a5

5 files changed

+739

-1

lines changed

csrc
- attention
  - decode_attention_kernel_in8kv_flashdecoding_diverse.cu
- ops_bindings.cpp
include
- ops_common.h
lightllm_kernel/ops
- __init__.py
- attention.py

5 files changed

+739

-1

lines changed

Comments

(0)