GPU usage limiter during machine learning

[ronzino83]

I have searched the existing feature requests, both open and closed, to make sure this is not a duplicate request.

• Yes

The feature

During ML process, GPU utilization hits 100% and stay at this value during the whole process.
The whole system and other apps that need GPU will struggle in this scenario.

It would be good to have sort of limiter (like the other ones for CPU https://immich.app/docs/install/environment-variables#machine-learning ) for the GPU

Platform

• Server
• Web
• Mobile

[bo0tzz]

You can already tune this with the env vars you linked (in particular the threads/workers ones), as well as by limiting the jobs concurrency on the immich-server side.