Skip to content

Commit bd58ac7

Browse files
committed
forgot to init self.hamming_keep_chunks_head and self.hamming_keep_chunks_tail
1 parent 99cdca0 commit bd58ac7

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

ucm/sparse/kvcomp/kvcomp_hbm.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -152,6 +152,9 @@ def __init__(self, vllm_config: VllmConfig, role: UcmSparseRole):
152152
else:
153153
self.max_batch_size = min(self.max_batch_size, vllm_config.scheduler_config.max_num_seqs)
154154

155+
self.hamming_keep_chunks_head = 1
156+
self.hamming_keep_chunks_tail = 4
157+
155158
self.chunk_sizes_for_hamming_full = torch.full([self.max_batch_size],
156159
fill_value=self.block_size,
157160
dtype=torch.int32,

0 commit comments

Comments
 (0)