[Detector Support]: has anyone tried the amd ryzen ai max processors? Do they work with this?

[zombiehoffa]

The minisforum n5 pro that is about to be released seems pretty interesting for an NVR (5 spinning rust bays and a ryzen ai9 HX pro 370) if the npu on board actually work for inferencing (even better if it works through lxc/vm pass through so I can install proxmox and utilize any spare cpu cycles). I'm going to have a little under 20 4k cameras to deal with soon so thinking of interesting options.

[NickM-27]

The NPU is not yet supported in mainline linux kernel as far as I understand, so it is not known. The GPU would work fine with ROCm presumably, for object detection

[bluearcher-bc]

Linux 6.14 released 24 Mar 2025 with amdxdna NPU support. But its not an LTS release and neither is 6.15 and probably its going to be a while until we get an LTS kernel with the driver in it. So "later this year" is my best guess, like November.. and then you have to wait for your favorite distro to release with that kernel.

https://kernelnewbies.org/Linux_6.14#Add_amdxdna_driver_for_AMD_NPUs

[Rich7690]

As a minor comment to this, I currently have the ryzen ai 9 HX pro 370 running under the 0.17 dev builds that have 7.1.1 drivers (c136e5e-rocm as of writing). The 890M GPU works decently under onnx detectors depending on the model sizes. Would be nice to get NPU's working eventually if possible, but yea it needs the newer kernels and drivers

semi-related: I noticed this issue someone brought up to the xdna driver repo amd/xdna-driver#178 as well which is primarily related to using it under VMs which pointed to the virtio NPU implementation which is interesting: https://github.com/amd/virtio-npu. Might be nice to also support the virtio npu setup as well then folks could pass it through to VM setups.

[zombiehoffa]

It would still be nice to have this but i ended up going aoostar wtr max with multiple hailo nvme cards for more nvr storage and lots of nvme for hailo cards. I have two in there now doing 17 4k cameras no problem

[bluearcher-bc]

LTS kernel 6.18 was released 30 November 2025 so hopefully we will start seeing it show up in distros soon.

for me, I will have to watch for 6.18 to arrive in the Debian backports repo for Debian 13 because Debian 14 won't release until 2027.. as badly as I want to get an AMD Ryzen AI proc for this job, I might end up just getting an Intel unit with an NPU ...

[lainwir3d]

Apparently there have been some progress the last few weeks on NPU support on linux (or at least someone is running LLMs on the NPU)