Provide more useful error when exiting for empty config directories

[antoniomika]

Supersedes #316

We should provide a more useful fatal error when directories we need to exist don't. The current error is a generic panic.