[Backend Tester] Seed based on test name

[GregoryComer]

Set a manual seed for pytorch based on the test base name (test case not including flow / etc.). This makes test results stable between runs and between backends/flows. This is useful for comparing accuracy between backends, for example.

I validated this change by running convolution tests for xnnpack twice. I validated that the output accuracy statistics were identical.

[GregoryComer]

Stack from ghstack (oldest at bottom):

• -> [Backend Tester] Seed based on test name #13313
• [Backend Tester] Reduce log verbosity / spam #13312
• [Backend Tester] Add subtest index field #13311
• Link Vulkan backend with pybinding lib when built #13309
• [Backend Tester] Write report progressively #13308
• [Backend Tester] Clean up report output #13306
• [Backend Tester] Clean up a few test issues #13258
• [Backend Tester] Add portable test flow #13250
• [Backend Tester] Report PTE size #13249
• [Backend Tester] Report delegation statistics #12846
• [Backend Tester] Report quantization and lowering times #12838
• [Backend Tester] Add tensor error statistic reporting #12809
• [Backend Tester] Add CSV report generation #12741
• [Backend Tester] Add Qualcomm tester and register flow #12739

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13313

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 2 Unrelated Failures

As of commit a62c6d0 with merge base 3a02146 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  At least one of the pre-conditions you specified did not hold
• Lint / lintrunner / linux-job (gh)
  >>> Lint for backends/test/suite/runner.py:
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  backends/arm/test/models/stable_diffusion/test_vae_AutoencoderKL.py::TestAutoencoderKL::test_AutoencoderKL_tosa_MI
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t a025547bc8a35f3e5acaaccf13681a1978c37193a8cac451d551caa9398129df /exec failed with exit code 1

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)
• pull / test-selective-build-linux / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.