Skip to content

feat(android): enable experimental ggml-hexagon backend#314

Draft
jhen0409 wants to merge 7 commits intomainfrom
ggml-hexagon
Draft

feat(android): enable experimental ggml-hexagon backend#314
jhen0409 wants to merge 7 commits intomainfrom
ggml-hexagon

Conversation

@jhen0409
Copy link
Member

@jhen0409 jhen0409 commented Dec 5, 2025

Same with mybigday/llama.rn#247. Currently confirmed it able to run on 8 Elite device and performance are better than CPU.

TODO:

  • Build prebuilt libraries so user doesn't need to download Hexagon SDK
  • Integrate opencl backend
    • Support select gpu_device (0: GPUOpenCL, 1: HTP0, ...)
  • Support attach ggml_threadpool
  • Adjust max threads
  • Apply useGpu param to initContext
  • Fix exception catch of ggml-hexagon.cpp

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments