Skip to content

Commit d83f5a1

Browse files
authored
Support vllm max model len (#394)
1 parent 22af2e6 commit d83f5a1

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

swift/llm/utils/argument.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -540,8 +540,8 @@ def __post_init__(self) -> None:
540540
self.stream = False
541541
logger.info('Setting self.stream: False')
542542
self.infer_media_type = template_info.get('infer_media_type', 'none')
543-
if args.neftune_noise_alpha <= 0:
544-
args.neftune_noise_alpha = None
543+
if self.neftune_noise_alpha <= 0:
544+
self.neftune_noise_alpha = None
545545

546546
@staticmethod
547547
def check_ckpt_dir_correct(ckpt_dir) -> bool:

0 commit comments

Comments
 (0)