You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update on "[ET-VK][AOT] Enable exporting Q8 Quantized Linear + Convolution"
As title. Introduce fusion patterns to enable fusing quantized convolution and linear graph patterns into a custom op.
## Changes
Introduce the concept of using custom pattern detection functions to detect graph patterns rather than solely relying on SubgraphMatcher. The issue with SubgraphMatcher is that a large number of graph patterns may need to be exported to obtain variants for different combinations of decompositions/quantization workflows. Having a custom detection function improves maintainability.
Implement detection + replacement functions for quantized linear and quantized conv2d.
Differential Revision: [D81323425](https://our.internmc.facebook.com/intern/diff/D81323425/)
[ghstack-poisoned]
echo" --pte=<PTE_FILE>|semihosting pte file (generated by the aot_arm_compier from the model to include in the elf), or semihosting to supply pte at runtime."
37
-
echo" --target=<TARGET> Target to build and run for Default: ${target}"
38
-
echo" --build_type=<TYPE> Build with Release, Debug or RelWithDebInfo, default is ${build_type}"
39
-
echo" --bundleio Support both pte and Bundle IO bpte using Devtools BundelIO with Input/RefOutput included"
40
-
echo" --system_config=<CONFIG> System configuration to select from the Vela configuration file (see vela.ini). Default: Ethos_U55_High_End_Embedded for EthosU55 targets, Ethos_U85_SYS_DRAM_Mid for EthosU85 targets."
41
-
echo" NOTE: If given, this option must match the given target. This option along with the memory_mode sets timing adapter values customized for specific hardware, see ./executor_runner/CMakeLists.txt."
42
-
echo" --memory_mode=<CONFIG> Vela memory mode, used for setting the Timing Adapter parameters of the Corstone platforms."
43
-
echo" Valid values are Shared_Sram(for Ethos-U55, Ethos-U65, Ethos-85), Sram_Only(for Ethos-U55, Ethos-U65, Ethos-U85) or Dedicated_Sram(for Ethos-U65, Ethos-U85)."
44
-
echo" Default: Shared_Sram for the Ethos-U55 and Sram_Only for the Ethos-U85"
45
-
echo" --etdump Adds Devtools etdump support to track timing, etdump area will be base64 encoded in the log"
46
-
echo" --extra_build_flags=<FLAGS> Extra flags to pass to cmake like -DET_ARM_BAREMETAL_METHOD_ALLOCATOR_POOL_SIZE=60000 Default: none "
echo" --et_build_root=<FOLDER> Build output root folder to use, defaults to ${et_build_root}"
49
-
echo" --ethosu_tools_dir=<FOLDER> Path to your Ethos-U tools dir if you not using default: ${ethosu_tools_dir}"
50
-
echo" --toolchain=<TOOLCHAIN> Toolchain can be specified (e.g. bare metal as arm-none-eabi-gcc or zephyr as arm-zephyr-eabi-gcc Default: ${toolchain}"
51
-
echo" --select_ops_list=<OPS> Comma separated list of portable (non delagated) kernels to include Default: ${select_ops_list}"
52
-
echo" NOTE: This is used when select_ops_model is not possible to use, e.g. for semihosting or bundleio."
53
-
echo" See https://docs.pytorch.org/executorch/stable/kernel-library-selective-build.html for more information."
36
+
echo" --pte=<PTE_FILE>|<ADDR>|semihosting Set to a pte file (generated by the aot_arm_compier) to include the model in the elf."
37
+
echo" Or a hex address in the format of 0x00000000 if placed in memory you need to place it on this ADDR on your target, with your flash tool or other means."
38
+
echo" Or specify the word 'semihosting' to supply pte at runtime."
39
+
echo" --target=<TARGET> Target to build and run for Default: ${target}"
40
+
echo" --build_type=<TYPE> Build with Release, Debug or RelWithDebInfo, default is ${build_type}"
41
+
echo" --bundleio Support both pte and Bundle IO bpte using Devtools BundelIO with Input/RefOutput included"
42
+
echo" --system_config=<CONFIG> System configuration to select from the Vela configuration file (see vela.ini). Default: Ethos_U55_High_End_Embedded for EthosU55 targets, Ethos_U85_SYS_DRAM_Mid for EthosU85 targets."
43
+
echo" NOTE: If given, this option must match the given target. This option along with the memory_mode sets timing adapter values customized for specific hardware, see ./executor_runner/CMakeLists.txt."
44
+
echo" --memory_mode=<CONFIG> Vela memory mode, used for setting the Timing Adapter parameters of the Corstone platforms."
45
+
echo" Valid values are Shared_Sram(for Ethos-U55, Ethos-U65, Ethos-85), Sram_Only(for Ethos-U55, Ethos-U65, Ethos-U85) or Dedicated_Sram(for Ethos-U65, Ethos-U85)."
46
+
echo" Default: Shared_Sram for the Ethos-U55 and Sram_Only for the Ethos-U85"
47
+
echo" --etdump Adds Devtools etdump support to track timing, etdump area will be base64 encoded in the log"
48
+
echo" --extra_build_flags=<FLAGS> Extra flags to pass to cmake like -DET_ARM_BAREMETAL_METHOD_ALLOCATOR_POOL_SIZE=60000 Default: none "
echo"Build Arm ${toolchain/-gcc/} executor_runner for ${target}with${pte_file} using ${system_config}${memory_mode}${extra_build_flags} to '${output_folder}'"
154
+
echo"Build Arm ${toolchain/-gcc/} executor_runner for ${target}PTE:${pte_file} using ${system_config}${memory_mode}${extra_build_flags} to '${output_folder}'"
0 commit comments