Add MPS runner test

[jathu]

Summary

TSIA

Test plan

CI

$ .ci/scripts/test_model.sh mv3 cmake mps

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11238

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 1 Unrelated Failure

As of commit 5370c2a with merge base 809a1fd ():

NEW FAILURES - The following jobs have failed:

• trunk / test-apple-model / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 139
• trunk / test-qnn-model (fp32, ic3) / linux-job (gh)
  RuntimeError: Command docker exec -t cd019ba73677abc39b71a118be6d33925077f72c3b96301b30889ccb0937cbd6 /exec failed with exit code 1

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• trunk / test-llama-torchao-lowbit / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 134

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[mergennachin]

There are no reasons not to support MPS out-of-the box. I will update docs in a follow-up PR.

It's not as stable compared to coreml. Let's not do this for now.

[jathu]

@mergennachin good point, I didn't realize MPS wasn't P0. I've repurposed the diff to include MPS runner tests, so we can still use that in the future.