-
Notifications
You must be signed in to change notification settings - Fork 1k
Description
Currently tests are typically run against the initial (base) and latest version in the muzzle range.
The muzzle checks tell us that there are no API-incompatible changes in the versions in the middle that affect the instrumentation. But what muzzle can't tell us is if there were any behavior changes in the versions in the middle that could somehow affect things, e.g. #5027 where the API signature didn't change, but the behavior of the API changed.
This happens fairly rarely, but it still may be worth testing against more versions to help close this gap.
A reasonable option seems to be to test against all initial major versions (or some configurable definition of versions), e.g. hibernate 5.0.0 (#5210), when the muzzle range spans multiple major versions (or some long time frame of releases).