We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent b1a90ab commit 08db751Copy full SHA for 08db751
example/e-rag.cpp
@@ -257,7 +257,8 @@ int main() try {
257
std::string modelGguf = AC_TEST_DATA_LLAMA_DIR "/gpt2-117m-q6_k.gguf";
258
std::string embeddingModelGguf = AC_TEST_DATA_LLAMA_DIR "/bge-small-en-v1.5-f16.gguf";
259
260
- ac::llama::ResourceCache cache;
+ ac::local::ResourceManager rm;
261
+ ac::llama::ResourceCache cache(rm);
262
263
// create objects for the inference
264
auto model = cache.getModel({.gguf = modelGguf});
0 commit comments