I thought this is a bug
applitools/Eyes.Sdk.JavaScript#63
But Liran from Applitools told me this is a feature.
So...
Solution
In order to allow a single test to have a different viewport size,
we need to set the viewport size back to the default after each test.
Or we give up on this feature, and document it well.