Integrate llama.cpp and ggml quantized models, soon?

[vmajor]

Could we approve the merge that will allow integration with llama.cpp and ggml models?

#70

[seraph-wing]

the new update hould answer your question :)