Update generative-proof-of-concept-CPU-preprocessing-in-memory.py

david-thrower · web-flow · commit 2c39c462173c · 2025-10-14T17:08:22.000-04:00
Fix params on create_dataset() call.
diff --git a/generative-proof-of-concept-CPU-preprocessing-in-memory.py b/generative-proof-of-concept-CPU-preprocessing-in-memory.py
@@ -1372,7 +1372,7 @@ def create_dataset(raw_text_sample, tokenizer, sample_expansion_batch_size=10) -
             )
             return dataset
 
-        phase_i_b_dataset = create_dataset(raw_text_sample=phase_i_b_samples, tokenizer, sample_expansion_batch_size=10)
+        phase_i_b_dataset = create_dataset(raw_text_sample=phase_i_b_samples, tokenizer=tokenizer, sample_expansion_batch_size=10)
        
         # To Do: Set .fit() params <------<<<
 

Original file line number	Diff line number	Diff line change
`@@ -1372,7 +1372,7 @@ def create_dataset(raw_text_sample, tokenizer, sample_expansion_batch_size=10) -`
`1372`	`1372`	`)`
`1373`	`1373`	`return dataset`
`1374`	`1374`
`1375`		`- phase_i_b_dataset = create_dataset(raw_text_sample=phase_i_b_samples, tokenizer, sample_expansion_batch_size=10)`
	`1375`	`+ phase_i_b_dataset = create_dataset(raw_text_sample=phase_i_b_samples, tokenizer=tokenizer, sample_expansion_batch_size=10)`
`1376`	`1376`
`1377`	`1377`	`# To Do: Set .fit() params <------<<<`
`1378`	`1378`