Tempo introduced an option to delete empty tenants in this PR: grafana/tempo#3611
This should be able to be enabled by setting the option empty_tenant_deletion_enabled under storage.trace, but the tempo-distributed helm chart does not support setting this value.