We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4efeced commit 4d6ccb3Copy full SHA for 4d6ccb3
README.md
@@ -31,7 +31,6 @@ In addition, [@dominictarro](https://github.com/dominictarro) maintains a Rust p
31
## Quickstart 👩💻
32
The code snippet below demonstrates how to chunk text with `semchunk`:
33
```python
34
-
35
import semchunk
36
import tiktoken # `transformers` and `tiktoken` are not required.
37
from transformers import AutoTokenizer # They're just here for demonstration purposes.
0 commit comments