EasyCache doesn't work?

[GreenShadows]

If KoboldCPP uses SD.cpp as its engine, why does EasyCache not seem to work?

Am I doing something wrong? I tried activating it via command line and in the GUI where it says default parameters.

--easycache

[LostRuins]

Sorry, easycache is not currently supported in koboldcpp. Although it uses SD.cpp as its engine, not all features are enabled out of the box.

[GreenShadows]

Okay, for some reason I still don't understand, SD.cpp with easycache is a little slower than KoboldCpp. I'm using the same parameters in both, it's strange.

[wbruna]

Okay, for some reason I still don't understand, SD.cpp with easycache is a little slower than KoboldCpp. I'm using the same parameters in both, it's strange.

If you tested a less-than-14h sd.cpp build, Koboldcpp uses a much more recent ggml version.

Also, depending on the parameters EasyCache may not be able to skip any step (especially for low-step generations).