Skip to content

Commit a782971

Browse files
committed
feat(quant): add optional layer_type parameter to get_pergroup_param method
1 parent 290b490 commit a782971

File tree

2 files changed

+4
-2
lines changed

2 files changed

+4
-2
lines changed

vllm_ascend/quantization/w8a8.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,8 @@ def get_perchannel_param(
8686
return params_dict
8787

8888
def get_pergroup_param(self, input_size: int, output_size: int,
89-
params_dtype: torch.dtype) -> Dict[str, Any]:
89+
params_dtype: torch.dtype,
90+
layer_type: Optional[str] = None) -> Dict[str, Any]:
9091
return {}
9192

9293
@staticmethod

vllm_ascend/quantization/w8a8_dynamic.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,8 @@ def get_perchannel_param(
6363
return params_dict
6464

6565
def get_pergroup_param(self, input_size: int, output_size: int,
66-
params_dtype: torch.dtype) -> Dict[str, Any]:
66+
params_dtype: torch.dtype,
67+
layer_type: Optional[str] = None) -> Dict[str, Any]:
6768
return {}
6869

6970
@staticmethod

0 commit comments

Comments
 (0)