Skip to content

Commit c74a3e9

Browse files
authored
Add description on oneapi builds
1 parent 8f418be commit c74a3e9

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,4 +25,5 @@ Server images are tagged in the format of `server-<ssl>-<avx>`.
2525
- `avx`: (Only) AVX instruction set is enabled. Might be useful if you are using some old CPUs that don't support AVX2.
2626
- `avx2`: AVX2 instruction set is enabled. This build should support most modern/recent CPUs with reasonable performance.
2727
- `avx512`: AVX512 and AVX512-VNNI instruction sets are enabled. Currently only some high-end or server-grade CPUs support these instruction sets, so check your hardware specs before using this build.
28+
- `oneapi`: Experimental build with the Intel oneAPI compiler, inspired by ggerganov/llama.cpp#5067. Offers a ~30% speed increase (~20tok/s vs ~15tok/s) in prompt processing on my machine compared to `avx2` builds. Not updated daily.
2829

0 commit comments

Comments
 (0)