We noticed that Output Cache cached our page that had some exception. After we republished configuration, page was fixed. However, because it was cached, we still saw error on the page.
It would be nice to skip caching if any of child actions failed.