Skip to content

Commit 1dd8002

Browse files
committed
Update LLamaEmbedder, Examples packages, and KernelMemory examples
- Embedding generation: Extension with Batch processing + Normalization (important to have this built-in for KernelMemory). - Examples had wrong nuget packages, updated to correct ones. - Updated KernelMemory examples. - added missing model parameters - adding config is null check - unit tests project update to prevent the constant download of many GBs - ** for some reason Embeddings must be set to false in the kernel memory text embedding generator => we need to follow this and check it later because this should normally be 'true' ! ** - skipping one test for macOS (all other tests are OK) - setting GpuLayerCount to 0 as an experiment
1 parent c0981f0 commit 1dd8002

File tree

1 file changed

+10
-9
lines changed

1 file changed

+10
-9
lines changed

LLama.Unittest/Constants.cs

Lines changed: 10 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -20,15 +20,16 @@ public static int CIGpuLayerCount
2020
{
2121
get
2222
{
23-
if (RuntimeInformation.IsOSPlatform(OSPlatform.OSX))
24-
{
25-
#if DEBUG
26-
return 20;
27-
#else
28-
return 0;
29-
#endif
30-
}
31-
else return 20;
23+
return 0;
24+
//if (RuntimeInformation.IsOSPlatform(OSPlatform.OSX))
25+
//{
26+
// #if DEBUG
27+
// return 20;
28+
// #else
29+
// return 0;
30+
// #endif
31+
//}
32+
//else return 20;
3233
}
3334
}
3435
}

0 commit comments

Comments
 (0)