Skip to content

Commit 1dfe13a

Browse files
committed
aiu int8 unit tests
Signed-off-by: Iqbal Saraf <[email protected]>
1 parent 460b76b commit 1dfe13a

7 files changed

+15
-0
lines changed

tests/aiu_addons/conftest.py

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -84,6 +84,21 @@ def get_gptq_gemm_inputs(request) -> tuple[torch.Tensor, ...]:
8484
"atype": "per_tensor_symm", # per_tensor_asymm, per_token
8585
"smoothquant": False,
8686
},
87+
{
88+
"wtype": "per_tensor", # per_channel
89+
"atype": "per_token", # per_tensor_asymm, per_token
90+
"smoothquant": False,
91+
},
92+
{
93+
"wtype": "per_channel", # per_channel
94+
"atype": "per_tensor_asymm", # per_tensor_asymm, per_token
95+
"smoothquant": False,
96+
},
97+
{
98+
"wtype": "per_channel", # per_channel
99+
"atype": "per_token", # per_tensor_asymm, per_token
100+
"smoothquant": False,
101+
},
87102
]
88103

89104

Binary file not shown.
Binary file not shown.
0 Bytes
Binary file not shown.
Binary file not shown.
-192 Bytes
Binary file not shown.
-64 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)