AMD IPU

[rhenry74]

There are already millions of NPU equipped systems out in the wild.
We are talking about the 7x4x and 8x4x series of AMD CPUs that have neural processors built in.

I am having good success with this nuget package. I'm running Llama 3 Instruct on a 7840HS mini PC, just on CPU. I am so much more productive in C# and Visual Studio thanks to this project.

I really wish I could utilize the AMD Ryzen AI NPU.

https://www.askideas.com/media/13/Cute-Kitten-Says-Please.jpg