File tree Expand file tree Collapse file tree 2 files changed +4
-4
lines changed
Expand file tree Collapse file tree 2 files changed +4
-4
lines changed Original file line number Diff line number Diff line change @@ -257,7 +257,7 @@ chats\_to\_tokens
257257
258258``` python
259259chats_to_tokens(
260- chat: Chat | None ,
260+ chat: Chat,
261261 tokenizer: AutoTokenizer,
262262 * ,
263263 apply_chat_template_kwargs: dict[str , Any]
@@ -272,7 +272,7 @@ Transform a chat into a tokenized format with structured slices.
272272** Parameters:**
273273
274274* ** ` chat ` **
275- (` Chat | None ` )
275+ (` Chat ` )
276276 –The chat object to tokenize.
277277* ** ` tokenizer ` **
278278 (` AutoTokenizer ` )
@@ -286,7 +286,7 @@ Transform a chat into a tokenized format with structured slices.
286286<Accordion title = " Source code in rigging/data.py" icon = " code" >
287287``` python
288288async def chats_to_tokens (
289- chat : Chat | None ,
289+ chat : Chat,
290290 tokenizer : AutoTokenizer,
291291 * ,
292292 apply_chat_template_kwargs : dict[str , t.Any] | None = None ,
Original file line number Diff line number Diff line change @@ -294,7 +294,7 @@ async def chats_to_elastic(
294294
295295
296296async def chats_to_tokens (
297- chat : Chat | None ,
297+ chat : Chat ,
298298 tokenizer : AutoTokenizer ,
299299 * ,
300300 apply_chat_template_kwargs : dict [str , t .Any ] | None = None ,
You can’t perform that action at this time.
0 commit comments