Skip to content

Commit 08db751

Browse files
committed
chore: update rag example
1 parent b1a90ab commit 08db751

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

example/e-rag.cpp

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -257,7 +257,8 @@ int main() try {
257257
std::string modelGguf = AC_TEST_DATA_LLAMA_DIR "/gpt2-117m-q6_k.gguf";
258258
std::string embeddingModelGguf = AC_TEST_DATA_LLAMA_DIR "/bge-small-en-v1.5-f16.gguf";
259259

260-
ac::llama::ResourceCache cache;
260+
ac::local::ResourceManager rm;
261+
ac::llama::ResourceCache cache(rm);
261262

262263
// create objects for the inference
263264
auto model = cache.getModel({.gguf = modelGguf});

0 commit comments

Comments
 (0)