Skip to content

Commit c9cab7c

Browse files
authored
Update cognitive-search-skill-textsplit.md
Updated a typo for token splitting
1 parent eeffe70 commit c9cab7c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

articles/search/cognitive-search-skill-textsplit.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.service: azure-ai-search
88
ms.custom:
99
- ignite-2023
1010
ms.topic: reference
11-
ms.date: 10/01/2024
11+
ms.date: 10/29/2024
1212
---
1313

1414
# Text split cognitive skill
@@ -67,7 +67,7 @@ Parameters are case-sensitive.
6767
"textSplitMode": "pages",
6868
"unit": "azureOpenAITokens",
6969
"azureOpenAITokenizerParameters":{
70-
"encoderModelName":"cl100k",
70+
"encoderModelName":"cl100k_base",
7171
"allowedSpecialTokens": [
7272
"[START]",
7373
"[END]"

0 commit comments

Comments
 (0)