Revert "Fix layout bounds not accounting for padding"

[RobLoach]

Reverts #156

@aganm @Hejsil This change reverts the layout bounds change. May be worth considering removing the change until we fix it for good. What do you think?

[RobLoach]

@Hejsil Considering #390 , there may be other regressions we're seeing out of this. Mind if we revert and then fix it up afterwards?

[aganm]

I just tried #160 and it had none of the regressions we found with #156.
Some pieces must be missing for it to work correctly.
Personally I would revert #156, double check #160 and pull it in.

[Hejsil]

@Hejsil Considering #390 , there may be other regressions we're seeing out of this. Mind if we revert and then fix it up afterwards?

Sure. I dont have much time until January to look into this so lets revert. Sorry for the breakage 🙏

[RobLoach]

No worries! Can be difficult to check all features. Hope we can get some automated tests going at some point to check.