Skip to content

Commit b9b0483

Browse files
Fix argument syntax in prepare_data function call
1 parent dc62473 commit b9b0483

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

generative-proof-of-concept-CPU-preprocessing-in-memory.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -441,7 +441,7 @@ def package_non_instruct_text(text: str, desired_samples: int, max_length_tokens
441441
# data += non_instruct_samples
442442

443443
##<<##<<
444-
x, y, vocab_size = prepare_data(data_0=non_instruct_samples, tokenizer_0=toeknizer, max_seq_length=MAX_SEQ_LENGTH, prompt_length: int = 1)
444+
x, y, vocab_size = prepare_data(data_0=non_instruct_samples, tokenizer_0=toeknizer, max_seq_length=MAX_SEQ_LENGTH, prompt_length = PROMPT_LENGTH)
445445
# x, y, vocab_size = prepare_data() # data)
446446

447447
print("Input IDs shape:", len(x), "x", len(x[0]) if x else 0)

0 commit comments

Comments
 (0)