Skip to content

Commit 495fcdf

Browse files
authored
Fix KVCacheScaleType Import (#1846)
Summary - Fix CLI
1 parent eab8bf7 commit 495fcdf

File tree

1 file changed

+1
-1
lines changed
  • src/llmcompressor/modifiers/quantization

1 file changed

+1
-1
lines changed

src/llmcompressor/modifiers/quantization/cache.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99

1010
from typing import Any, Dict, List, Optional, Tuple
1111

12-
from compressed_tensors.quantization.lifecycle import KVCacheScaleType
12+
from compressed_tensors.quantization import KVCacheScaleType
1313
from compressed_tensors.quantization.quant_args import QuantizationArgs
1414
from torch import Tensor
1515
from transformers import DynamicCache

0 commit comments

Comments
 (0)