a project to integrate all ggml related projects and wrap it to rust.
reduce the compile time and avoid symbol conflict.
currently still WIP
currently it has
- llama.cpp
- whisper.cpp
- sense-voice.cpp (A Chinese whisper developed by ALiBaBa)
when build for android, you shall set ~/.cargo/config.toml
with linker and ar, like:
[target.aarch64-linux-android]
linker = "/android-ndk-r27c//toolchains/llvm/prebuilt/linux-x86_64/bin/aarch64-linux-android32-clang"
ar = "/android-ndk-r27c//toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar
android api version in aarch64-linux-androidXX-clang
shall >=28,