Skip to content

Run tests against more versions in muzzle range #5286

@trask

Description

@trask

Currently tests are typically run against the initial (base) and latest version in the muzzle range.

The muzzle checks tell us that there are no API-incompatible changes in the versions in the middle that affect the instrumentation. But what muzzle can't tell us is if there were any behavior changes in the versions in the middle that could somehow affect things, e.g. #5027 where the API signature didn't change, but the behavior of the API changed.

This happens fairly rarely, but it still may be worth testing against more versions to help close this gap.

A reasonable option seems to be to test against all initial major versions (or some configurable definition of versions), e.g. hibernate 5.0.0 (#5210), when the muzzle range spans multiple major versions (or some long time frame of releases).

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions