[Backend Tester] Add markdown summary in CI

[GregoryComer]

Add a nice markdown summary in the GitHub actions job. This will show up when clicking on the run on a PR. It's intended to give an easy way to see the results without needing to download the job artifact.

See https://github.com/pytorch/executorch/actions/runs/17090546309 for example output.

[GregoryComer]

Stack from ghstack (oldest at bottom):

• -> [Backend Tester] Add markdown summary in CI #13535
• [Backend Tester] Add additional quantized test flows for XNNPACK and Vulkan #13534
• [Backend Tester] Add test flows for QNN #13469
• Link QNN backend to pybinding lib when built #13467

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13535

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 40 Cancelled Jobs

As of commit cbcc830 with merge base 0856f59 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  At least one of the pre-conditions you specified did not hold
• Lint / lintrunner / linux-job (gh)
  >>> Lint for backends/test/suite/generate_markdown_summary.py:
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t 212b24b64f5fb8f8618477d316ac298bcc155d265f914d79198ba3ad86240f32 /exec failed with exit code 1

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• Build Presets / apple (ios-simulator) / build (gh)
• Build Presets / apple (ios) / build (gh)
• Build Presets / apple (llm) / build (gh)
• Build Presets / apple (macos) / build (gh)
• Build Presets / apple (profiling) / build (gh)
• Build Presets / apple (pybind) / build (gh)
• Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
• Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
• Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
• Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
• Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
• Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
• Build Presets / windows (pybind) / build (gh)
• Build Presets / zephyr (zephyr) / build (gh)
• nightly / backend-test-linux (qnn_16a16w, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a16w, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a4w_block, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a4w_block, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a4w, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a4w, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a8w, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_16a8w, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_8a8w, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn_8a8w, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (qnn, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (vulkan_static_int8_per_channel, operators) / linux-job (gh)
• nightly / backend-test-linux (vulkan, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_dynamic_int8_per_channel, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_dynamic_int8_per_channel, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_static_int8_per_channel, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_static_int8_per_channel, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_static_int8_per_tensor, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack_static_int8_per_tensor, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack, models) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-linux (xnnpack, operators) / linux-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-macos (coreml_static_int8, models) / macos-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-macos (coreml_static_int8, operators) / macos-job (gh)
  ##[error]The operation was canceled.
• nightly / backend-test-macos (coreml, models) / macos-job (gh)
  ##[error]The operation was canceled.
• trunk (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.