We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent cea853e commit d9881b0Copy full SHA for d9881b0
tests/e2e/vLLM/recipes/INT8/recipe_w8a8_static_asym.yaml
@@ -7,5 +7,5 @@ quant_stage:
7
config_groups:
8
group_0:
9
weights: {num_bits: 8, type: int, symmetric: true, strategy: channel}
10
- input_activations: {num_bits: 8, symmetric: false, dynamic: false, strategy: channel, type: int}
+ input_activations: {num_bits: 8, symmetric: false, dynamic: false, strategy: tensor, type: int}
11
targets: [Linear]
0 commit comments