Update generative-proof-of-concept-CPU-preprocessing-in-memory.py

Try more settings for top_p top_k

Author: david-thrower

generative-proof-of-concept-CPU-preprocessing-in-memory.py

@@ -1069,8 +1069,12 @@ def complete_text(text):
                 do_sample=True,
                 max_new_tokens=20,
                 temperature=0.6,
-                top_k=40,
-                top_p=0.985,
+                # One set of recommendations
+                top_k=75,
+                top_p=0.95,
+                # Previous semi-working values
+                # top_k=40,
+                # top_p=0.985,
                 # repetition_penalty=1.2,
                 presence_penalty=1.2,
                 frequency_penalty=1.4