How's the NPU support? Does Jan utilize NPUs?

[ux-han]

NPUs support?

[ux-han]

We have an experimental implementation of ONNX, but are having some issues targeting the Snapdragon NPU.
Current Status

• The current status is that it works (?) somewhat with the Adreno GPU, but we haven't gotten it to work on the NPU
• We are currently busy implementing the Cortex CLI, but should be done in sprint 19 (6 August 2024)

[Neard-AI]

Will Intell Ultra processor NPU be supported soon?

[iMonZ]

Will Intell Ultra processor NPU be supported soon?

Any updates here?

[Code-Vlue]

Any news on NPU support?

[h-n-a]

Any plans to support AMD NPUs? AMD Ryzen 7 AI 350.

user@pop-os:~$ readlink -f /sys/class/accel/accel0/device/driver
/sys/bus/pci/drivers/amdxdna
user@pop-os:~$ cat /sys/class/accel/accel0/device/uevent
DRIVER=amdxdna
PCI_CLASS=118000
PCI_ID=1022:17F0
PCI_SUBSYS_ID=1043:20CF
PCI_SLOT_NAME=0000:04:00.1
MODALIAS=pci:v00001022d000017F0sv00001043sd000020CFbc11sc80i00