You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
(If you'd like lowbit to use KleidiAI when available, you can instead install with `EXECUTORCH_BUILD_KERNELS_TORCHAO=1 TORCHAO_BUILD_KLEIDIAI=1 python install_executorch.py`.)
349
+
348
350
Also note that low-bit quantization often requires QAT (quantization-aware training) to give good quality results.
349
351
350
352
First export your model for lowbit quantization (step 2 above):
0 commit comments