Skip to content

Commit 8e6c7e8

Browse files
authored
[Bugfix] Fix MoE BNB version (#22260)
Signed-off-by: Jee Jee Li <[email protected]>
1 parent 6a51530 commit 8e6c7e8

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

vllm/model_executor/layers/quantization/bitsandbytes.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -412,12 +412,12 @@ class BitsAndBytesMoEMethod(FusedMoEMethodBase):
412412
def __init__(self, quant_config: BitsAndBytesConfig):
413413
try:
414414
import bitsandbytes
415-
if bitsandbytes.__version__ < "0.45.3":
415+
if bitsandbytes.__version__ < "0.46.1":
416416
raise ImportError("bitsandbytes version is wrong. Please "
417-
"install bitsandbytes>=0.45.3.")
417+
"install bitsandbytes>=0.46.1.")
418418
except ImportError as err:
419-
raise ImportError("Please install bitsandbytes>=0.45.3 via "
420-
"`pip install bitsandbytes>=0.45.3` to use "
419+
raise ImportError("Please install bitsandbytes>=0.46.1 via "
420+
"`pip install bitsandbytes>=0.46.1` to use "
421421
"bitsandbytes quantizer.") from err
422422
self.topk_indices_dtype = None
423423
self.quant_config = quant_config

0 commit comments

Comments
 (0)