We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent a2bd621 commit ec8d252Copy full SHA for ec8d252
scripts/snapdragon/adb/run-bench.sh
@@ -19,6 +19,9 @@ device="HTP0"
19
verbose=""
20
[ "$V" != "" ] && verbose="$V"
21
22
+opmask=
23
+[ "$OPMASK" != "" ] && opmask="GGML_HEXAGON_OPMASK=$OPMASK"
24
+
25
nhvx=
26
[ "$NHVX" != "" ] && nhvx="GGML_HEXAGON_NHVX=$NHVX"
27
@@ -31,6 +34,6 @@ adb $adbserial shell " \
31
34
cd $basedir; \
32
35
LD_LIBRARY_PATH=$basedir/$branch/lib \
33
36
ADSP_LIBRARY_PATH=$basedir/$branch/lib \
- $ndev $nhvx ./$branch/bin/llama-bench --device $device --mmap 0 -m $basedir/../gguf/$model \
37
+ $ndev $nhvx $opmask ./$branch/bin/llama-bench --device $device --mmap 0 -m $basedir/../gguf/$model \
38
-t 4 --batch-size 128 -ngl 99 $@ \
39
"
0 commit comments