Skip to content

Commit bb998f5

Browse files
authored
Fix multimodal target modules (#3858)
1 parent fe9429d commit bb998f5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

swift/llm/train/tuner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ def get_multimodal_target_regex(
6969

7070
ignore_pattern = ['lora_A', 'lora_B', 'base_layer']
7171
if ignore_embedding:
72-
ignore_pattern += ['.*emb.*', 'wte', 'shared']
72+
ignore_pattern += [r'\w*emb\w*', 'wte', 'shared']
7373
ignore_pattern += model_arch.embedding or []
7474
# lm_head
7575
ignore_pattern += ['lm_head', 'output', 'score', 'v_head', 'classifier']

0 commit comments

Comments
 (0)