Skip to content

Commit 2b3abfc

Browse files
decode
1 parent 62e3409 commit 2b3abfc

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

decode_examples.py

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
from crayon import CrayonVocab
2+
3+
vocab = CrayonVocab(device="auto")
4+
vocab.load_profile("lite")
5+
6+
text = "Hello, world!"
7+
tokens = vocab.tokenize(text)
8+
print(tokens)
9+
decode=vocab.decode(tokens)
10+
print(decode)

0 commit comments

Comments
 (0)