v20230308 ValueError: Expected parameter logits

[plasmaphase]

I've noticed in the last several versions that with longer audio files I occasionally (but consistently) get the following error:

ValueError: Expected parameter logits (Tensor of shape (1, 51865)) of distribution Categorical(logits: torch.Size([1, 51865])) to satisfy the constraint IndependentConstraint(Real(), 1), but found invalid values:
tensor([[nan, nan, nan,  ..., nan, nan, nan]], device='cuda:0')

Some files process to completion, but the ones that don't fail at the same moment consistently.

[jongwook]

Hi, are you using the default arguments in the command line, and would you be able to share an audio file that fails consistently?

[jongwook]

In Python, you can fix the temperature at zero by: model.transcribe(..., temperature=0) (it's (0.0, 0.2, 0.4, 0.6, 0.8, 1.0) if you don't specify this)

[ai-bits]

whisper audio.m4a --model medium --language English --temperature_increment_on_fallback None

With --temperature.. the error is gone, but output is still trash.
Cross-posting from "ValueError Tensor on external RTX 2070" #1248
TIA for any further insights!

[NuperSu]

I also got this error (used medium model and ru lang). With --temperature_increment_on_fallback None, it run without errors but outputted:

[00:29.240 --> 00:59.240] """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""#

[Jacky-MYQ]

Though this error diappeared by using this way, my txt became "!!!!!!!!!!!!!!!!!" which is not my video voice. However, i try to add "fp16=False" in this code model.transcribe("..",fp16=False) . I find out this mistake diappears ValueError: Expected parameter logits (Tensor of shape (1, 51865)) of distribution Categorical(logits: torch.Size([1, 51865])) to satisfy the constraint IndependentConstraint(Real(), 1), but found invalid values: tensor([[nan, nan, nan, ..., nan, nan, nan]], device='cuda:0') and i got a useful txt! So, the problem is settled!

[AriyaRasekh]

Any update on this?

[DmitrySandalov]

Try using fp16=False in Python and --fp16 False in the command line.