Update generative-proof-of-concept-CPU-preprocessing-in-memory.py

For now replace "\n" in text samples to make logged generated text more readable and searchable.

Author: david-thrower

generative-proof-of-concept-CPU-preprocessing-in-memory.py

@@ -325,7 +325,7 @@ def package_non_instruct_text(text: str, desired_samples: int, max_length_tokens
 
             # Add the final sample if we have any remaining sentences
             if current_sample_sentences and len(samples) < desired_samples:
-                sample = " ".join(current_sample_sentences)
+                sample = " ".join(current_sample_sentences).replace("\n",' ')
                 samples.append(sample)
 
             return samples