See #1357 and #1337 This is tricky behavior and we don't have any integration test to make sure that it does not accidentally break in the future.