Update base for Update on "Fix Cuda out of memory issue for eager runner"

This PR updates the eager runner to disable grad and save memory usage.

It also update the prompt format to not include bos.

Differential Revision: [D65962743](https://our.internmc.facebook.com/intern/diff/D65962743/)

[ghstack-poisoned]

Author: helunwencser