If you add 2 layers in a row (i.e. don't remove the first one and press add twice for 2 different layers in the dropdown), only the most recent layer is removed and there is no way to remove the first selected layer unless you refresh the application