Skip to content

Commit 764460a

Browse files
committed
fix
Signed-off-by: Will Johnson <mwjohnson728@gmail.com>
1 parent c719594 commit 764460a

File tree

1 file changed

+7
-3
lines changed

1 file changed

+7
-3
lines changed

plugins/accelerated-moe/src/fms_acceleration_moe/utils/scattermoe_prepare.py

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -352,9 +352,13 @@ def prepare_scattermoe(
352352
"input_linear",
353353
"output_linear",
354354
]
355-
if any(
356-
module in (target_modules or []) for module in possible_target_modules
357-
) or not lora_config:
355+
if (
356+
any(
357+
module in (target_modules or [])
358+
for module in possible_target_modules
359+
)
360+
or not lora_config
361+
):
358362
if device_mesh is None:
359363
# - if not on meta, just load the state dict
360364
# - and then put on the device

0 commit comments

Comments
 (0)