Skip to content

Commit f50a955

Browse files
authored
Merge pull request #14 from voidful/codex/find-and-fix-a-bug
Fix missing return in tok_begin
2 parents 5942b86 + 1a0e418 commit f50a955

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tfkit/utility/tok.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ def tok_begin(tokenizer):
1111
if tokenizer.special_tokens_map.get('bos_token') is not None:
1212
return tokenizer.special_tokens_map.get('bos_token')
1313
elif tokenizer.special_tokens_map.get('cls_token') is not None:
14-
tokenizer.special_tokens_map.get('cls_token')
14+
return tokenizer.special_tokens_map.get('cls_token')
1515
return 'cls'
1616

1717

0 commit comments

Comments
 (0)