add-phase-to-metadata-in-logged-text-samples #271
Description
From branch #270
Complete the information on the generated text samples being logged on the LLM Phase-I-a and Phase-I-b training script:
- Add to logged text samples: The phase model checkpoint that it is generating from.
- On the Phase I-b samples, make these log the correct perplexity (the metric from phase I-b not phase I-a)