[Feature] Machine Learning using Intel NPU in OpenVINO on supported Core Ultra Processors

[volschin]

I have searched the existing feature requests to make sure this is not a duplicate request.

• Yes

The feature

I have installed the drivers regarding the Release notes on my Ubuntu 24.04.

• https://github.com/intel/linux-npu-driver/releases/tag/v1.10.0

The /dev/accel/accel0 device is available on the host system now. I attached it to the Immich machine learning image by adding a further device with

• /dev/accel:/dev/accel

This doesn‘t seem to be enough, to enable it in the Immich ml image for openvino.
There will be more and more of the Core Ultra CPU with integrated NPU on the market.

it would be nice to have this working in the container.

Platform

• Server
• Web
• Mobile

[absamue]

+1

As a comparison, using the NPU for object detection is recommended by Scrypted NVR: https://docs.scrypted.app/buyers-guide/servers.html#nvr-recommendations

[janchanru]

Good afternoon! Any chances of adding AMD NPU support? I have an AMD Ryzen 7 7640HS with NPU, would love to see it utilized in Immich. It could drastically reduce power consumption compared to GPU.