Arm backend: Add function to return quant params for lowered graph

[wwwind]

Summary:
Add function to return quant params for lowered graph and remove these Q/DQ from the graph. If they are needed, then the EdgeProgramManager should be copied before use of this function.

Change-Id: I09de39c603d68d5ac5de4614a35eb7e3fc9ba518

Signed-off-by: Elena Zhelezina [email protected]

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12390

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 16 Pending, 5 Unrelated Failures

As of commit 62db20b with merge base aaf0a4c ():

NEW FAILURES - The following jobs have failed:

• pull / test-build-wasm-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 4ebef70c22c1ebb3b630fb537c3f5cab0ff0ee2319df38975b08252c71f51fe8 /exec failed with exit code 1
• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 2ebd7498a6891d5c155c37b430dae3b603dd44b99e2151d5b99a5ab39a63871f /exec failed with exit code 1
• trunk / test-arm-cortex-m-size-test (bare_metal) / linux-job (gh)
  RuntimeError: Command docker exec -t 270facda284a461b15402c42518b2e060ac9fa2435e1f8fb56751ac98b233276 /exec failed with exit code 1

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
• pull / unittest-editable / linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
• trunk / test-qnn-model (fp32, ic4) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• trunk / unittest-release / linux / linux-job (gh) (trunk failure)
  [ FAILED ] TensorPtrMakerTest.FailedCreateTensorUsingFromBlobWithIllegalStrides
• trunk / unittest-release / macos / macos-job (gh) (trunk failure)
  [ FAILED ] TensorPtrMakerTest.FailedCreateTensorUsingFromBlobWithIllegalStrides

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[digantdesai]

Perhaps I am missing something, can you help me understand the motivation please?

[digantdesai]

Perhaps move this to the quantize_io_pass.py?

[wwwind]

Thank you for the review! @digantdesai

We need this function in our workflow: we have a graphic use case when we need to move out Q/DQ nodes and get scale/zero points so we prepare input data in our plugin. Then we pass it to the subgraph. Currently, we need to call these two passes and then to extract these data from config, which is not very friendly for our users. Here there is just one function call that does this job.

[digantdesai]

Sound good. Can you please move this util in the pass file? Thanks.

[wwwind]

Replaced with #12481