We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent a12beee commit 61bcdaaCopy full SHA for 61bcdaa
src/accelerate/utils/dataclasses.py
@@ -2768,7 +2768,7 @@ class BnbQuantizationConfig:
2768
Enable 8bit quantization.
2769
llm_int8_threshold (`float`, defaults to `6.0`):
2770
Value of the outliner threshold. Only relevant when `load_in_8bit=True`.
2771
- load_in_4_bit (`bool`, defaults to `False`):
+ load_in_4bit (`bool`, defaults to `False`):
2772
Enable 4bit quantization.
2773
bnb_4bit_quant_type (`str`, defaults to `fp4`):
2774
Set the quantization data type in the `bnb.nn.Linear4Bit` layers. Options are {'fp4','np4'}.
0 commit comments