Skip to content

Conversation

@jeffzhou2000
Copy link

@jeffzhou2000 jeffzhou2000 commented Mar 8, 2025

this PR add text-based diagram of high-level software architecture in toplevel README.md, it will provide a high level comprehension for llama.cpp beginner. from this simple diagram,

  • we can clearly see that the ggml machine learning library/framework is a really compact & concise machine learning library/framework!
  • we can clearly see what we can do/contribute for this project with our expertise.
  • propose PAL(ggml-pal) in toplevel README.md, this difficult and performance-sensitive work can be done by the original authors or other domain experts. this idea comes from my effort on https://github.com/ggml-org/llama.cpp/pull/12049 since 04/2024. in the fact, this is not original idea because this idea can be found at Qualcomm's QNN SDK and Google's Android OS or some commercial massive complicated software in embedded system.
    Screenshot from 2025-03-22 14-17-13

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant