Problems with koboldcpp

[Alexey688]

After opening koboldcpp (I tried different versions), I can't specify the path to the model, no characters are entered and the window closes after 15-20 seconds. I'm not good at all this, please explain in simple language.

[gustrd]

Try opening it at console (command prompt, cmd). Post here the message that is being sent.

[Alexey688]

I tried it before, all the same

[Alexey688]

I also open the model using koboldcpp, but still the window closes after a while.

[gustrd]

Do you have enough memory at your computer?

[Alexey688]

yes

[Alexey688]

all the same

[gustrd]

Sorry, I mean RAM Memory. How much free RAM do you have before loading? It need at least the .bin file size, a little more.

[Alexey688]

I have 12 GB of RAM, that is, even with the browser running, 60% ~7-8 GB remain free.
In the screenshot, I managed to launch something, is this not how it should be?

[gustrd]

@LostRuins , I find strange that here he could start loading a model.

[LostRuins]

@gustrd His device probably does not support avx2, and he has not used the --noavx2 flag.

[gustrd]

@LostRuins the Cyrillic characters at his path could be an issue also?

[gustrd]

The Cyrillic is not the issue, I tried to reproduce the error but it worked ok. Probably it's AVX2.

[gustrd]

I think that may be the problem, try with a smaller model first, like ggml-alpaca-7b-q4 ( ex: https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml ).

[Alexey688]

So I have a problem because before choosing a model, koboldcpp closes and I can't enter anything

[Alexey688]

This problem is before the model selection

[gustrd]

Your printscreen shows a model being loaded. I don't understand. Have you tried just clicking the exe, not the shortcut?

[Alexey688]

I've already tried opening it a lot

[gustrd]

So I have no other ideas, sorry.

[LostRuins]

@Alexey688 your device may not support the AVX2 instruction.

Can you try opening it with from the Run window with the extra flag --noavx2?

[LostRuins]

Okay, does the choose file window appear?

[Alexey688]

No, nothing appears there and I can't write anything

[LostRuins]

Okay, try run this command which avoids using the GUI. You need to manually pass in the model file path when running.

run C:\koboldcpp.exe --noavx2 --model C:\modelfoldername\ggml-model-q4_0.bin

Replace with the location of your model.bin file

[Alexey688]

The window also closes quickly when the model is defined

[LostRuins]

In that case, maybe your PC is not compatible with the even AVX1 instructions, and KoboldCpp will not work.

I'll leave this issue open for a while, in case anyone else has the same problem or found a solution...