A yellow outline doesn't disappear after removing a feature in editing mode

1. Click to the feature and highlight it
2. Turn on editing mode of the layer with highlighted feature
3. Remove the highlighted feature
4. Turn off editing mode, save changes.
5. The yellow highlighted feature is still visible, **but it must not.**