Unfortunately the HTML doc compilation does not return a non-zero exit status when examples don't compile. Perhaps this is a job for sphinx-gallery too (ping @Titan-C).
If docs fail to compile does maintainer currently get notified?
This behaviour would have avoided scikit-learn/scikit-learn#5170 and other example error issues.