We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 50d253c commit 71ee846Copy full SHA for 71ee846
examples/sycl/run-llama2.sh
@@ -13,7 +13,7 @@ source /opt/intel/oneapi/setvars.sh
13
INPUT_PROMPT="Building a website can be done in 10 simple steps:\nStep 1:"
14
MODEL_FILE=models/llama-2-7b.Q4_0.gguf
15
NGL=33
16
-CONEXT=8192
+CONEXT=4096
17
18
if [ $# -gt 0 ]; then
19
GGML_SYCL_DEVICE=$1
0 commit comments