How to remove parameters from optimizer with Basefinetuning?

[grudloff]

I need to train sequentially disjoint parts of a model. Is there a way to remove parameters groups from the optimizer before adding new parameter groups, or is there a way to set the parameter group?

This post suggests this:

optim.param_group.clear() # optim.param_group = []
optim.state.clear() # optim.state = defaultdict(dict)

Is this a good way to do it? Is there another alternative?