You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update base for Update on "[llm] Add a generic text only LLM runner"
Introducing `text_llm_runner`. This can be used to run all text only decoder only LLM models supported by ExecuTorch.
* Metadata is being read out from the .pte file and being used to construct the runner object.
* examples/models/llama/runner.h[.cpp] only contains a simple wrapper around `text_llm_runner.h[.cpp]`.
In next PRs I will move examples/models/phi-3-mini/runner to use the generic runner.
Will look into QNN and MediaTek runners as well.
Differential Revision: [D75910889](https://our.internmc.facebook.com/intern/diff/D75910889/)
[ghstack-poisoned]
0 commit comments