[mlir][tosa] tosa-to-linalg missed lowering with EXT-DYNAMIC enabled

[ShivaChen]

With https://www.mlplatform.org/tosa/tosa_spec_1_0_1.html, some inputs could be non-constant when EXT-DYNAMIC enabled due to CTC (Compile Time Constant) disabled.

As @lhutton1 suggested, this issue served as a checklist to track the relative issues in tosa-to-linalg pass. The pass should allow the lowering for non-constant inputs when EXT-DYNAMIC enabled.

Current tracking issues are:

• MUL shift: [mlir][tosa] Allow shift operand of tosa::MulOp as non-constant #155197
  [mlir][tosa] Remove Tosa MulOp Commutative attribute #163312
• RESCALE multiplier, shift, input_zp and output_zp: [mlir][tosa] Support RescaleOp with dynamic extension in TosaToLinalg #155967
• AVG_POOL2D input_zp, output_zp
• CONV2D input_zp, weight_zp
• CONV3D input_zp, weight_zp
• DEPTHWISE_CONV2D input_zp, weight_zp
• MATMUL A_zp, B_zp
• NEGATE input1_zp, output_zp:
  [mlir][tosa] support NegateOp with dynamic extension in TosaToLinalg #158782
• TABLE table
• TRANSPOSE_CONV2D input_zp, weight_zp

Excluded since shape_t is required to be constant in version 1.0.1 of the specification (see here):

• PAD padding, pad_const
• RESHAPE shape
• SLICE start, size
• RESIZE scale, offset, border
• TILE multiples

[llvmbot]

@llvm/issue-subscribers-mlir

Author: None (ShivaChen)

With https://www.mlplatform.org/tosa/tosa_spec_1_0_1.html#_rescale, multiplier, shift, input_zp and output_zp could be non-constant with EXT-DYNAMIC enabled.

tosa-to-linalg forbidden non-constant inputs which make following Tosa Conformance tests failed.
rescale_22x20_i32_outi8_sc0_rmS_pc0_iu0_ou0_dyn
rescale_31x18_i8_outi8_sc0_rmS_pc0_iu1_ou0_dyn
rescale_20x19_i16_outi8_sc0_rmS_pc0_iu1_ou0_dyn

#155967 intends to relax the restriction and lowering with non-constant inputs of Tosa rescaleOp.