-
Beta Was this translation helpful? Give feedback.
Answered by
NBcobo
May 10, 2023
Replies: 1 comment 5 replies
-
Do you have enough RAM to run this model? How much RAM do you have? Can you test with a smaller model first? https://huggingface.co/concedo/cerebras-111M-ggml/blob/main/cerberas-111m-q4_0.bin |
Beta Was this translation helpful? Give feedback.
5 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Thank you!
I found a closed issue #56 which is exactly like mine.
It turns out my CPU only supports AVX, not AVX2. With the --noavx2 option, I can get the chat going finally.
Great appreciate all your help!