Skip to content

Improve diff-perf evaluation #114

@ldoktor

Description

@ldoktor

With the #113 we only use results with stddev ignoring the ones without it. This is fine when all tests use multiple samples (or single ones) but in case of a combination we are leaving the other part aside, which we should address.

One way would be to use weight based on the number of checks per each category or we can make the weights configurable (remember, we also have non-primary results, perhaps we might want to aid that as well).

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions