- Must have very low false positivity rate - Must run quickly - Should be data efficient - Should provide nice visualizations on failures that paint a compelling picture that the failure is real - Should perform drift detection - Should track performance separately across operating systems or other configurable values - Should provide searchable, browsable visualizations of all tracked parameters - Should easily interoperate with other visualization and benchmarking programs and data formats - Should use to test this package - Should provide an interface for users of this package to use - Should provide regression testing to Base - Should support measuring TTFX, load time, compile time, and classic runtime. - Should support arbitrary real numbers
