Tiles shifting when changing zoom (different origins per zoom level)

[mskvorc]

I'm using flutter_map 8.2.2 and have a problem with a tiles shifting during zoom in/out. I'm using a custom CRS with different origins per zoom level (required because of the WMTS configuration) and it seems that this is the cause of the problem. The problem is mostly visible when zoom level passes 8.5 and 9.5 and only for a short period of time (200-300ms) and then the tiles position correctly. I suppose that tiles for the new zoom level are loaded using the origin from the previous zoom level and after the new origin for this zoom level is loaded tiles reposition correctly. I would like to keep the pinch-zoom functionality, so I'm wondering how to solve this problem? I tried to use a custom tileBuilder within TileLayer configuration and use Transform.translate but it doesn't give me desired results. Maybe the only solution for this is to write my custom TileLayer class with layer dependent origins, and use unique origin in my CRS definition. Is there a better/easier solution?