Mixed precision on an Huggingface models

[marcmk6]

Hi,

I'm incorporating a huggingface model into my own one (only for inference). It seems setting precision=16 in Trainer is not effective on this model. I'm wondering what should I do to use it in mixed precision.

Thanks