Skip to content

Commit ab29b7a

Browse files
ImadSaddikszybia
authored andcommitted
Fixed a small typo in tokenizer-reference.md (elastic#135138)
Co-authored-by: Szymon Bialkowski <[email protected]>
1 parent 181b016 commit ab29b7a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/reference/text-analysis/tokenizer-reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ mapped_pages:
88
::::{admonition} Difference between {{es}} tokenization and neural tokenization
99
:class: note
1010

11-
{{es}}'s tokenization process produces linguistic tokens, optimized for search and retrieval. This differs from neural tokenization in the context of machine learning and natural language processing. Neural tokenizers translate strings into smaller, subword tokens, which are encoded into vectors for consumptions by neural networks. {{es}} does not have built-in neural tokenizers.
11+
{{es}}'s tokenization process produces linguistic tokens, optimized for search and retrieval. This differs from neural tokenization in the context of machine learning and natural language processing. Neural tokenizers translate strings into smaller, subword tokens, which are encoded into vectors for consumption by neural networks. {{es}} does not have built-in neural tokenizers.
1212

1313
::::
1414

0 commit comments

Comments
 (0)