[Backend Tester] Clean up report output

[GregoryComer]

Update the report output to be a bit cleaner. I've made the following changes:

• Round decimal values to 3 decimal places.
• Remove mean signed deviation and L2 norm. We have SNR, mean absolute error, and max element-wise error. I think that's sufficient.
• Rename SQNR to SNR. Not all tests are quantized and we're using it as a general measure of tensor-wise error.
• Split out the result column into pass/skip/fail and a detailed reason. This should be easier to parse at a glance.

Example output (not sure markdown formatting is weird here...):

Test ID	Test Case	Flow	Params	Result	Result Detail	Delegated	Quantize Time (s)	Lower Time (s)	Delegated Nodes	Undelegated Nodes	Delegated Ops	Undelegated Ops	PTE Size (Kb)	Output 0 Error Max	Output 0 Error MAE	Output 0 SNR	Output 1 Error Max	Output 1 Error MAE	Output 1 SNR
test_add_dtype_float32_xnnpack	test_add_dtype	xnnpack	{'dtype': torch.float32}	Pass		TRUE		3.747	1	0	{'aten::add.Tensor': 1}	{}	1.6	0	0	inf
test_add_dtype_float32_xnnpack_static_int8_per_channel	test_add_dtype	xnnpack_static_int8_per_channel	{'dtype': torch.float32}	Pass		TRUE	0.66	0.818	7	0	{'aten::add.Tensor': 1, 'quantized_decomposed::dequantize_per_tensor': 3, 'quantized_decomposed::quantize_per_tensor': 3}	{}	2	0	0	inf

[GregoryComer]

Stack from ghstack (oldest at bottom):

• [Backend Tester] Reduce log verbosity / spam #13312
• [Backend Tester] Add subtest index field #13311
• Link Vulkan backend with pybinding lib when built #13309
• [Backend Tester] Write report progressively #13308
• -> [Backend Tester] Clean up report output #13306
• [Backend Tester] Clean up a few test issues #13258
• [Backend Tester] Add portable test flow #13250
• [Backend Tester] Report PTE size #13249
• [Backend Tester] Report delegation statistics #12846
• [Backend Tester] Report quantization and lowering times #12838
• [Backend Tester] Add tensor error statistic reporting #12809
• [Backend Tester] Add CSV report generation #12741
• [Backend Tester] Add Qualcomm tester and register flow #12739

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13306

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 4 Pending

As of commit bba2fa9 with merge base 3a02146 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  At least one of the pre-conditions you specified did not hold
• Lint / lintrunner / linux-job (gh)
  >>> Lint for backends/test/suite/reporting.py:
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  backends/arm/test/models/stable_diffusion/test_vae_AutoencoderKL.py::TestAutoencoderKL::test_AutoencoderKL_tosa_MI
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t 6885efaf02ce15cea3d7b6972551f0724cab2b7672640d1151d4232c37e07c80 /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.