Update generative-proof-of-concept-CPU-preprocessing-in-memory.py

Run intermediate number of samples on same params:

10 samples -> perplexity of ~ 10 - 11
200 samples -> perplexity of ~ 21

See at which data set size the weights saturate with this dimensionality.

Author: david-thrower

generative-proof-of-concept-CPU-preprocessing-in-memory.py

@@ -59,7 +59,7 @@ def objective(trial: optuna.Trial) -> float:
     # Number of text samples to create: # Number of text samples (of approximately max_seq_len) to create 
     # Raises RAM in a linear fashion
 
-    SAMPLES_TO_CREATE = 200
+    SAMPLES_TO_CREATE = 50 # 200
 
     # How many tokens to provide before expecting the next token to be predicted. 
     # Half this = double RAM  (inversely proportional to RAM requirement)