Update generative-proof-of-concept-CPU-preprocessing-in-memory.py

Lower top_p. Often there is only 1 word to sample from.

Author: david-thrower

generative-proof-of-concept-CPU-preprocessing-in-memory.py

@@ -1070,7 +1070,7 @@ def complete_text(text):
                 max_new_tokens=20,
                 temperature=0.6,
                 top_k=40,
-                top_p=0.95,
+                top_p=0.90,
                 repetition_penalty=1.2,
                 # presence_penalty=1.2,
                 # frequency_penalty=1.3