Resubmission of Arm backend: Split executor runner into init + run

[martinlsm]

The PR #12162 got reverted with #12171. This PR is a resubmission of the patch.

Refactor the main function of arm_executor_runner.cpp by extracting code that is related to initializing and running a model into two separate helper functions (runner_init and RunnerContext::run). A new struct called RunnerContext is introduced to store data/context required to run the model.

Test plan

Arm's CI runs and tests the changed code.

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12197

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Cancelled Job, 2 Unrelated Failures

As of commit 1f75e0f with merge base 5f70823 ():

NEW FAILURE - The following job has failed:

• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 5141eb9066e7b255044dbb2bbf0385db0651f4177e02eb7b645d0cf98a0898d9 /exec failed with exit code 139

CANCELLED JOB - The following job was cancelled. Please retry:

• trunk / test-qnn-model (fp32, mb) / linux-job (gh)
  ##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh) (similar failure)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• trunk / test-models-linux-aarch64 (mobilebert, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[martinlsm]

@pytorchbot label "partner: arm"

[martinlsm]

@pytorchbot label ciflow/trunk

[zingo]

Hi @digantdesai @metascroy as we don't know the original error this was reverted for we do not know if the rebase we did will solve this. E.g. We had to do some small change in the rebase as another PR landed in the same file.
Will you check this first or do we retry a merge tomorrow and see what happens?

[metascroy]

Hi @digantdesai @metascroy as we don't know the original error this was reverted for we do not know if the rebase we did will solve this. E.g. We had to do some small change in the rebase as another PR landed in the same file. Will you check this first or do we retry a merge tomorrow and see what happens?

Let me try importing and re-running to see if the error still exists. It might have been transient.

[facebook-github-bot]

@metascroy has imported this pull request. If you are a Meta employee, you can view this in D77872847.

[metascroy]

@metascroy has imported this pull request. If you are a Meta employee, you can view this in D77872847.

Things look good on internal tests, so let's try re-landing.