Skip to content

Commit f582b84

Browse files
authored
type fix
1 parent cf87c76 commit f582b84

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2649,7 +2649,7 @@ def set_vocab(self):
26492649
tokenizer = json.load(f)
26502650

26512651
vocab_size = tokenizer["vocab_size"]
2652-
tokens: list[str] = [f"[PAD{i}]".encode("utf-8") for i in range(vocab_size)]
2652+
tokens: list[str] = [f"[PAD{i}]" for i in range(vocab_size)]
26532653
scores: list[float] = [-10000.0] * vocab_size
26542654
toktypes: list[int] = [gguf.TokenType.UNUSED] * vocab_size
26552655

0 commit comments

Comments
 (0)