(Not really an issue... feel free to close.)
Theme styling can interrupt the block editor UX. Improvements to this plugins stylesheet
Interesting problem here. I wonder if making the controls a web component (ala <gutenberg-controls>) or whatever would be useful as then you have a Shadow DOM to work with with totally isolated styles.