[Feature Request] PyTorch M1 metal-accelerated device support

[AydarAkhmetzyanov]

🚀 Feature

https://pytorch.org/blog/introducing-accelerated-pytorch-training-on-mac/
PyTorch implemented m1 support for the upcoming release. It could significantly increase local development tests for apple devices.

Motivation

Speed up runs on apple devices with Apple’s Metal Performance Shaders (MPS)

I can create a PR for it 👍

[araffin]

Duplicate of #914

PR is already there: #951