We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4c45eff commit 7358094Copy full SHA for 7358094
examples/quantizing_moe/README.md
@@ -17,7 +17,7 @@ pip install -e .
17
The provided example script demonstrates an end-to-end process for applying the quantization algorithm:
18
19
```bash
20
-python3 mixtral_moe.py
+python3 mixtral_moe_fp8.py
21
```
22
23
## Creating a Quantized MoE Model
@@ -96,4 +96,4 @@ config_groups = {
96
}
97
98
recipe = GPTQModifier(config_groups=config_groups)
99
-```
+```
0 commit comments