Perf tests need to provide a visible failure rate metric

I am not sure whether this already exists. Maybe its a no-op.

But perf tests need to pass 100% of the time. There needs to be a very visible metric for this that we can monitor and track. Failing silently in CI is not a viable option.