Skip to content

Commit 968168b

Browse files
committed
fix: Updated check for gptqmodel version of external kernels
Signed-off-by: Brandon Groth <[email protected]>
1 parent 7167028 commit 968168b

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

fms_mo/custom_ext_kernels/utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -517,8 +517,8 @@ def exllama_ops_load_and_reg(qcfg=None, run_unit_test=False):
517517
need_registration = False
518518
else:
519519
need_registration = (
520-
available_packages["exllama_kernels"]
521-
and available_packages["exllamav2_kernels"]
520+
available_packages["gptqmodel_exllama_kernels"]
521+
and available_packages["gptqmodel_exllamav2_kernels"]
522522
)
523523

524524
if not need_registration:

0 commit comments

Comments
 (0)