support channels last inputs in xnnpack

[leafs1]

Summary

Support channels last inputs in xnnpack

Test plan

Wrote tests taking combinations of channels last/first inputs with ops requiring inputs of both forms.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11116

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 40 New Failures, 9 Pending, 1 Unrelated Failure

As of commit c5fbe29 with merge base 18ce8a8 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  RuntimeError: Command docker exec -t e64e6320e7973d28130a5ab3339684f756b579554c2fa5a0c2474d3eace78e32 /exec failed with exit code 2
• Build Linux Wheels / pytorch/executorch / build-manywheel-py3_10-cpu (gh)
  Process completed with exit code 1.
• Build Linux Wheels / pytorch/executorch / upload / upload-manywheel-py3_10-cpu (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x86_64
• Build macOS Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
  Process completed with exit code 1.
• Check Labels / Check labels (gh)
  RuntimeError: Error checking labels: PR does not have required labels
• Lint / lintrunner / linux-job (gh)
  >>> Lint for version.py:
• pull / android / build-llm-demo / linux-job (gh)
  /pytorch/executorch/extension/android/../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/examples/models/llama/../../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/examples/models/llama/../../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/text_token_generator.h:154:24: error: ‘class tokenizers::Tokenizer’ has no member named ‘is_loaded’
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  /pytorch/executorch/examples/models/llama/../../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/text_token_generator.h:154:24: error: ‘class tokenizers::Tokenizer’ has no member named ‘is_loaded’
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/examples/models/llama/../../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/text_token_generator.h:154:24: error: ‘class tokenizers::Tokenizer’ has no member named ‘is_loaded’
• pull / test-llama-runner-linux-android / linux-job (gh)
  /pytorch/executorch/examples/models/llama/../../../../executorch/extension/llm/runner/text_token_generator.h:154:24: error: no member named 'is_loaded' in 'tokenizers::Tokenizer'
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 66942f67c6fe5f592e17f1d8dca4f0086ab018f86bce1e8ce36f1feafd73b1c8 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 5f2118a31d54291330a54924c43b4a02b618481b23f4fcf9ebc3eeb171e96b60 /exec failed with exit code 1
• pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t fd19d5f28f65598c7fce3b7fc68c317dd7bc2afa29d3aa52b32839a5fbf225db /exec failed with exit code 1
• pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t fb42011962775585335cf987a73032f540bef6b74f7c7099730d6dd97df58a16 /exec failed with exit code 1
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 5b6582bdce629cdec89969e0714c4c2182f2ab2752291d4e9563e678a2dbf22c /exec failed with exit code 1
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t a1e3e1e2df547dcd3bfe4e875d926aaa04dd55aa33789ec255d83fcaed870b02 /exec failed with exit code 1
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t e0e1bd1cf47c18c96f3aff73b65feed30ce84025fb0260516d83a35ebacbd4f9 /exec failed with exit code 1
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 49ef98ce28a3599a8ac689e2768df0d73346638ca42971df0f56a58ef3a58bdd /exec failed with exit code 1
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4860904b744bf74b730638babaee8e3e3dbea6caa319b3e4cf2a28aaeb9ca677 /exec failed with exit code 1
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4923cd1a0b7dd9450ee819bb5cfabb5dbd89900d0f391c68cd863fa35683259c /exec failed with exit code 1
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 3b6d0508ffe1223bacc6c877f48bbc7810f9511e9d54c32fb3ca4b19b1f420cd /exec failed with exit code 1
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 6b5a3bc18c86426ed5bc8fddaff2ea6c6c405f7081e90b41368038d4f293905a /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 2071c3a9809ab9f7e43a3adeaee161c3a7c276ae4910acf2a5415b3851f6ab3e /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 75bfc8f8f23f51f945ef562d681a96de2db01046846d2d8303c3488aad499987 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t 2cd8f171774985f194cc3ad3e0410bfd3541be246073d056954ce3620fad3f1d /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 0f55232eacf4e631e72b3679f03e563a2be3827b9a4b8a75c54235888c1ec74c /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 1ee824070870ecc2f539b01ae134a5ffbd7aca07819283603255d5d10b893d78 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t b04c274c1181f6eb3e446f70983973d384142ead11fe88a82767a9a79d134adf /exec failed with exit code 1
• pull / test-moshi-linux / linux-job (gh)
  test_exported_decoder_xnnpack
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 3352188b7ee43a7f99f6e3ae07044cc61e434164eef2e3ad6ee54d3c63fdbf97 /exec failed with exit code 1
• pull / test-quantized-aot-lib-linux / linux-job (gh)
  RuntimeError: Command docker exec -t e6572875d47e722b442aa00cfa4874faeaaae8422a34f19a034f77f8d0da4bc3 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  backends/xnnpack/test/ops/test_mean_dim.py::TestMeanDim::test_qs8_mean_dim
• pull / unittest / macos / macos-job (gh)
  backends/xnnpack/test/ops/test_maxpool2d.py::TestMaxPool2d::test_qs8_maxpool2d
• pull / unittest-editable / linux / linux-job (gh)
  extension/llm/export/test_export_passes.py::ReplaceSDPAWithCustomSDPAPassTest::test_squeezable_mask
• pull / unittest-editable / macos / macos-job (gh)
  backends/xnnpack/test/passes/test_decompose_cat_pass.py::TestDecomposeCatPass::test_qs8_cat_gt_5

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• Build macOS Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:.

If not, please add the release notes: none label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.