Safe to remove a Custom Field from a Fieldset if existing data is present?

[synergy34]

Hello!

Was wondering whether is it safe or not to remove a Custom Field from a Fieldset if existing data is present, is this going to leave dirty data behind?

Thanks.