test xnnpack quant with program-data separation

[lucylq]

Run

python export_quant_xnnpack.py 

Notice that there are no external weights saved. When commenting out 'quantize_', we see weights saved externally.
This is because xnnpack fuses(?) the quantization nodes, and the original tag disappears.

I can also set a breakpoint in node_visitor.py and manually tag torchao_dequantize_affine_default. So I think we need some way to tag nodes post-to_edge_transform_and_lower.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14736

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Driver update on H100 and A100 instances

❌ 12 New Failures, 41 Cancelled Jobs

As of commit 9918d60 with merge base 270873f ():

NEW FAILURES - The following jobs have failed:

• Build Windows Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
  Process completed with exit code 1.
• Build Windows Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x64
• Lint / lintrunner / linux-job (gh)
  >>> Lint for export_quant_xnnpack.py:
• Lint / lintrunner-mypy / linux-job (gh)
  >>> Lint for export_quant_xnnpack.py:
• pull / unittest / linux / linux-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_w2l_model
• pull / unittest / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_resnet18_model
• pull / unittest / windows / windows-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  RuntimeError: Command docker exec -t 827806e51a2dce76e427510c695dd4b3fe14721b625740a28ca30391f897a46b /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t 3c0e71391a04404e9326512cd8df6079cbae74c59de9d5e9735d2ab05c4fe051 /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_w2l_model
• pull / unittest-editable / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_mv2_model
• pull / unittest-editable / windows / windows-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  ##[error]The operation was canceled.
• periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  ##[error]The operation was canceled.
• periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / android / build-llm-demo / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-lora-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-mediatek-models-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-moshi-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-openvino-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-samsung-models-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-static-llama-qnn-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-vulkan-models-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / test-vulkan-operators-linux / linux-job (gh)
  ##[error]The operation was canceled.
• pull / unittest-nxp-neutron / linux-job (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.