Skip to content

null-define/ggml-all-rs

Repository files navigation

GGML-ALL-RS (WIP)

a project to integrate all ggml related projects and wrap it to rust.

reduce the compile time and avoid symbol conflict.

currently still WIP

currently it has

  1. llama.cpp
  2. whisper.cpp
  3. sense-voice.cpp (A Chinese whisper developed by ALiBaBa)

build

when build for android, you shall set ~/.cargo/config.toml with linker and ar, like:

[target.aarch64-linux-android]
linker = "/android-ndk-r27c//toolchains/llvm/prebuilt/linux-x86_64/bin/aarch64-linux-android32-clang"
ar = "/android-ndk-r27c//toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar

android api version in aarch64-linux-androidXX-clang shall >=28,

About

No description or website provided.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages