Skip to content

Commit 61bcdaa

Browse files
authored
update bnb quantisation 4bit flag (#3828)
1 parent a12beee commit 61bcdaa

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/accelerate/utils/dataclasses.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2768,7 +2768,7 @@ class BnbQuantizationConfig:
27682768
Enable 8bit quantization.
27692769
llm_int8_threshold (`float`, defaults to `6.0`):
27702770
Value of the outliner threshold. Only relevant when `load_in_8bit=True`.
2771-
load_in_4_bit (`bool`, defaults to `False`):
2771+
load_in_4bit (`bool`, defaults to `False`):
27722772
Enable 4bit quantization.
27732773
bnb_4bit_quant_type (`str`, defaults to `fp4`):
27742774
Set the quantization data type in the `bnb.nn.Linear4Bit` layers. Options are {'fp4','np4'}.

0 commit comments

Comments
 (0)