Skip to content

Commit f307748

Browse files
authored
Add tiktoken support in setup-with-qnn.sh (#4991)
Adding flags in the build process for QNN backend to enable tiktoken for llama3.
1 parent 959bb1b commit f307748

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

examples/demo-apps/android/LlamaDemo/setup-with-qnn.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@ cmake examples/models/llama2 \
3434
-DCMAKE_TOOLCHAIN_FILE=$ANDROID_NDK/build/cmake/android.toolchain.cmake \
3535
-DANDROID_ABI="$ANDROID_ABI" \
3636
-DCMAKE_INSTALL_PREFIX="${CMAKE_OUT}" \
37+
-DEXECUTORCH_USE_TIKTOKEN="${EXECUTORCH_USE_TIKTOKEN}" \
3738
-DEXECUTORCH_BUILD_KERNELS_CUSTOM=ON \
3839
-DCMAKE_BUILD_TYPE=Release \
3940
-B"${CMAKE_OUT}"/examples/models/llama2
@@ -45,6 +46,7 @@ cmake extension/android \
4546
-DANDROID_ABI="${ANDROID_ABI}" \
4647
-DCMAKE_INSTALL_PREFIX="${CMAKE_OUT}" \
4748
-DEXECUTORCH_BUILD_LLAMA_JNI=ON \
49+
-DEXECUTORCH_USE_TIKTOKEN="${EXECUTORCH_USE_TIKTOKEN}" \
4850
-DCMAKE_BUILD_TYPE=Release \
4951
-B"${CMAKE_OUT}"/extension/android
5052

0 commit comments

Comments
 (0)