This is similar to: #57 but this time we should check FAILed tests or tests with no results are properly reported in the comparison as well as in the html result.
As an example we can run fio test with a malfunctioning fio (compiled without libaio). Currently it will not complain and simply skip the results comparison.