Skip to content

Commit 57c8470

Browse files
authored
str -> bytes
1 parent c55c1ba commit 57c8470

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3702,7 +3702,7 @@ def _xlmroberta_set_vocab(self) -> None:
37023702

37033703
if self.model_arch == gguf.MODEL_ARCH.NOMIC_BERT_MOE:
37043704
# Add mask token missing from sentencepiece.bpe.model
3705-
tokens[250001] = "<mask>"
3705+
tokens[250001] = b'<mask>'
37063706
scores[250001] = 0.0
37073707
toktypes[250001] = SentencePieceTokenTypes.CONTROL
37083708

0 commit comments

Comments
 (0)