Unetr & SwinUnetr bottleneck layers weight freezing for transfer learning

[justinzhang528]

Dear MONAI Community,

I want to freeze the weights of the bottleneck layers of Unetr for transfer learning:

I want to set "requires_grad = True" for the weights of the bottleneck layers and "requires_grad = False" for the other layers except the bottleneck, but i have no idea which layers are bottleneck layers and which aren't. Could someone help me please?
I also want like to know about swinUnetr for freezing bottleneck layers.
Thanks in advance.

[KumoLiu]

Hi @tangy5, could you please share some comments on this one, thanks in advance!