We got some great feedback by Stefanos Kofopoulos on how to improve the UX for new users.
This includes things like improved formatting/styles, a settings link in the plugin list table (even though there are no settings right now), or some kind of animation to show the edit button.
This got me thinking if we should perhaps use a feature pointer for version 2.0 to show the edit button and new features.