First time using Kobold and similar softare in general

[aJIekc3D]

Im using: Xeon E5-2690v2 RX 570 8gb 16 RAM And latest version of koboldcpp (no cuda version) with "Wizard-Vicuna-13B-Uncensored.ggmlv3.q4_K_S" and Vulkan NoAVX2 + 10 GPU layers (cant understand if it`s even useful cuz 0% GPU and VRAM usage) with average speed 2.9 - 3.1 T/s. Can I impove speed somehow,or that the best i can get with my hardware?

[LostRuins]

This model is too old to use with Vulkan. Use a different backend, or get a more up-to-date model.

[aJIekc3D]

Both, The result is the same

[LostRuins]

Alright, maybe try the CLBlast NoAVX2 instead then

[aJIekc3D]

Now works as it should, yet still with lower speed than wizard model, but character initialization faster (1200 tokens in 40s with working vulkan vs 250s without it). Also played with gpu layers value (5-20), nothing changed except 2gb RAM usage difference

[LostRuins]

Unfortunately if you can't use AVX2 your options are rather limited. What are your PC specs? CPU?

[aJIekc3D]

Understood... I wrote pc specs in question description, xeon E5 2690v2