Two EmbeddingWrappers found for optimization

[irowberry]

I create an EmbeddingWrapper instance once within my model's initialize method, however when I print out the module instances in the get_finetune_parameters function, I have two showing up.

[lucidrains]

are you also using the OpenClipEmbeddingWrapper too? you should be only using one or the other, depending on how you are wiring it up

[irowberry]

No, I'm only using the EmbeddingWrapper.

[lucidrains]

ah i see, it is probably not correct then

no worries, i'll look early next month. valiant effort! what you are messing around with is top of the line research; good experience if you are looking to go towards the graduate school route :)