Is there an 8bit library for jax similar to bitsandbytes? #17256
Unanswered
aniquetahir
asked this question in
Q&A
Replies: 1 comment
-
|
Having a 8-bit quant of a model would be interesting to see how well it does. And to make it more accessible and cost less with resources and time to use. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
BitsandBytes library contains optimizers, multiplication and quantization functions. Is there an equivalent for jax/optax?
https://github.com/TimDettmers/bitsandbytes
Beta Was this translation helpful? Give feedback.
All reactions