Clean up some specifics in prompts.py

[andrewmusselman]

This seems like an artifact hack that should probably be dropped now that we're so explicitly passing model configs. Not for this PR, maybe future issue

Originally posted by @rawkintrevo in #546 (comment)