Is there a plan to support running Phi3 on the NPU of the Core Ultra #487
goxia
started this conversation in
Support for Targets (OS / EPs / Hardware)
Replies: 1 comment
-
Hi, thank you for the suggestion. I am moving this into our new targets Discussion so that we can look into it further |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, when running Phi3 through LM Studio, the load can only be run on top of the GPU.
Beta Was this translation helpful? Give feedback.
All reactions