Skip to content

Commit 2d18f3f

Browse files
ImadSaddikszybia
authored andcommitted
Fixed a small typo in tokenizer-reference.md (elastic#135138)
Co-authored-by: Szymon Bialkowski <[email protected]>
1 parent eb4c3cc commit 2d18f3f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/reference/text-analysis/tokenizer-reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ mapped_pages:
88
::::{admonition} Difference between {{es}} tokenization and neural tokenization
99
:class: note
1010

11-
{{es}}'s tokenization process produces linguistic tokens, optimized for search and retrieval. This differs from neural tokenization in the context of machine learning and natural language processing. Neural tokenizers translate strings into smaller, subword tokens, which are encoded into vectors for consumptions by neural networks. {{es}} does not have built-in neural tokenizers.
11+
{{es}}'s tokenization process produces linguistic tokens, optimized for search and retrieval. This differs from neural tokenization in the context of machine learning and natural language processing. Neural tokenizers translate strings into smaller, subword tokens, which are encoded into vectors for consumption by neural networks. {{es}} does not have built-in neural tokenizers.
1212

1313
::::
1414

0 commit comments

Comments
 (0)