Skip to content

Commit e96befb

Browse files
committed
fix internvl tokenizer
1 parent 2f45df5 commit e96befb

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/models/internvl/model.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -50,7 +50,7 @@ def encode(self, prompt, multimodal_params: MultimodalParams = None, **kwargs):
5050
image_count = len(multimodal_params.images)
5151
prompt = prompt.replace(IMG_TOKEN, image_tokens, image_count)
5252

53-
origin_ids = self.tokenizer.encode(prompt, kwargs["add_special_tokens"])
53+
origin_ids = self.tokenizer.encode(prompt, add_special_tokens=kwargs["add_special_tokens"])
5454
# <img></img> --> <img>id,id+1...id+num</img>
5555
input_ids = []
5656
image_id = 0

0 commit comments

Comments
 (0)