Can't transcribe a file #1681

kanishknishar · 2023-09-28T15:19:45Z

kanishknishar
Sep 28, 2023

I was trying to transcribe a file with English audio using my custom whisper command which failed and caused this output:

PS G:\Songs\David Bowie\09. Videos\Concerts\Subtitled\2002-07-18 - Montreux Jazz Festival, Switerzland> wp
Transcribing: 2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_01.mp4 at 28-09-2023 20:39:05
Traceback (most recent call last):
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 59, in load_audio
    out = run(cmd, capture_output=True, check=True).stdout
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ffmpeg', '-nostdin', '-threads', '0', '-i', '2002-07-18 - Montreux Jazz Festival, Switerzland\\bowie_montreux_01.mp4', '-f', 's16le', '-ac', '1', '-acodec', 'pcm_s16le', '-ar', '16000', '-']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Scripts\whisper.exe\__main__.py", line 7, in <module>
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\transcribe.py", line 456, in cli
    result = transcribe(model, audio_path, temperature=temperature, **args)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\transcribe.py", line 121, in transcribe
    mel = log_mel_spectrogram(audio, padding=N_SAMPLES)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 140, in log_mel_spectrogram
    audio = load_audio(audio)
            ^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 61, in load_audio
    raise RuntimeError(f"Failed to load audio: {e.stderr.decode()}") from e
RuntimeError: Failed to load audio: ffmpeg version 6.0-full_build-www.gyan.dev Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 12.2.0 (Rev10, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-ffnvcodec --enable-nvdec --enable-nvenc --enable-d3d11va --enable-dxva2 --enable-libvpl --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_01.mp4: No such file or directory

Finished Transcribing: 2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_01.mp4 at 09/28/2023 20:39:19
-------------------------------
Transcribing: 2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_02.mp4 at 28-09-2023 20:39:19
Traceback (most recent call last):
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 59, in load_audio
    out = run(cmd, capture_output=True, check=True).stdout
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ffmpeg', '-nostdin', '-threads', '0', '-i', '2002-07-18 - Montreux Jazz Festival, Switerzland\\bowie_montreux_02.mp4', '-f', 's16le', '-ac', '1', '-acodec', 'pcm_s16le', '-ar', '16000', '-']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Scripts\whisper.exe\__main__.py", line 7, in <module>
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\transcribe.py", line 456, in cli
    result = transcribe(model, audio_path, temperature=temperature, **args)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\transcribe.py", line 121, in transcribe
    mel = log_mel_spectrogram(audio, padding=N_SAMPLES)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 140, in log_mel_spectrogram
    audio = load_audio(audio)
            ^^^^^^^^^^^^^^^^^
  File "C:\Users\Lance\AppData\Local\Programs\Python\Python311\Lib\site-packages\whisper\audio.py", line 61, in load_audio
    raise RuntimeError(f"Failed to load audio: {e.stderr.decode()}") from e
RuntimeError: Failed to load audio: ffmpeg version 6.0-full_build-www.gyan.dev Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 12.2.0 (Rev10, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-ffnvcodec --enable-nvdec --enable-nvenc --enable-d3d11va --enable-dxva2 --enable-libvpl --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_02.mp4: No such file or directory

My custom whisper command:

function whisp([string]$file) {

    Write-Output "Transcribing: $($file) at $(Get-Date -Format 'dd/MM/yyyy HH:mm:ss')"
    whisper --model small.en --fp16 False --output_format "srt" "$file"
    Write-Output "Finished Transcribing: $($file) at $(Get-Date)`n-------------------------------"

}

function whisperPath () {

    Get-ChildItem *.mkv, *.mp4, *.ts, *.flac, *.m4a, *.ogg, *.opus, *.mp3 | ForEach-Object {
        $fileName = "$(Split-Path (Split-Path $_.FullName -Parent) -Leaf)\$($_.Name)";
        & whisp($fileName); 
    }

}

Set-Alias -Name wp -Value whisperPath

Pip components' version:

Package            Version
------------------ ---------
certifi            2023.7.22
charset-normalizer 3.2.0
colorama           0.4.6
filelock           3.12.4
idna               3.4
Jinja2             3.1.2
llvmlite           0.41.0
MarkupSafe         2.1.3
more-itertools     10.1.0
mpmath             1.3.0
networkx           3.1
numba              0.58.0
numpy              1.25.2
openai-whisper     20230918
pip                23.2.1
regex              2023.8.8
requests           2.31.0
setuptools         65.5.0
sympy              1.12
tiktoken           0.3.3
torch              2.0.1
tqdm               4.66.1
typing_extensions  4.8.0
urllib3            2.0.5

Python version:

Python 3.11.5 (tags/v3.11.5:cce6ba9, Aug 24 2023, 14:38:34) [MSC v.1936 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.

Whisper version: 20230918

The MediaInfo of the concerned file:

File MediaInfo:

General
Count                                    : 349
Count of stream of this kind             : 1
Kind of stream                           : General
Kind of stream                           : General
Stream identifier                        : 0
Count of video streams                   : 1
Count of audio streams                   : 1
Video_Format_List                        : AVC
Video_Format_WithHint_List               : AVC
Codecs Video                             : AVC
Video_Language_List                      : English
Audio_Format_List                        : AAC LC
Audio_Format_WithHint_List               : AAC LC
Audio codecs                             : AAC LC
Audio_Language_List                      : English
Audio_Channels_Total                     : 2
Complete name                            : G:\Songs\David Bowie\09. Videos\Concerts\Incomplete\2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_01.mp4
Folder name                              : G:\Songs\David Bowie\09. Videos\Concerts\Incomplete\2002-07-18 - Montreux Jazz Festival, Switerzland
File name extension                      : bowie_montreux_01.mp4
File name                                : bowie_montreux_01
File extension                           : mp4
Format                                   : MPEG-4
Format                                   : MPEG-4
Format/Extensions usually used           : braw mov mp4 m4v m4a m4b m4p m4r 3ga 3gpa 3gpp 3gp 3gpp2 3g2 k3g jpm jpx mqv ismv isma ismt f4a f4b f4v
Commercial name                          : MPEG-4
Format profile                           : Base Media
Internet media type                      : video/mp4
Codec ID                                 : isom
Codec ID                                 : isom (mp41)
Codec ID/Url                             : http://www.apple.com/quicktime/download/standalone.html
CodecID_Compatible                       : mp41
File size                                : 3561926421
File size                                : 3.32 GiB
File size                                : 3 GiB
File size                                : 3.3 GiB
File size                                : 3.32 GiB
File size                                : 3.317 GiB
Duration                                 : 6632640
Duration                                 : 1 h 50 min
Duration                                 : 1 h 50 min 32 s 640 ms
Duration                                 : 1 h 50 min
Duration                                 : 01:50:32.640
Duration                                 : 01:50:32:16
Duration                                 : 01:50:32.640 (01:50:32:16)
Overall bit rate                         : 4296240
Overall bit rate                         : 4 296 kb/s
Frame rate                               : 25.000
Frame rate                               : 25.000 FPS
Frame count                              : 165816
Stream size                              : 3642246
Stream size                              : 3.47 MiB (0%)
Stream size                              : 3 MiB
Stream size                              : 3.5 MiB
Stream size                              : 3.47 MiB
Stream size                              : 3.474 MiB
Stream size                              : 3.47 MiB (0%)
Proportion of this stream                : 0.00102
HeaderSize                               : 3642230
DataSize                                 : 3558284191
FooterSize                               : 0
IsStreamable                             : Yes
Codirector                               : codirector
Production studio                        : studio
ContentType                              : Unknown Type
Encoded date                             : 2016-01-30 00:06:39 UTC
Tagged date                              : 2016-01-30 00:06:39 UTC
File creation date                       : 2023-08-06 07:37:53.914 UTC
File creation date (local)               : 2023-08-06 13:07:53.914
File last modification date              : 2023-08-06 08:56:15.599 UTC
File last modification date (local)      : 2023-08-06 14:26:15.599
copy-warning                             : copy_warning

Video
Count                                    : 382
Count of stream of this kind             : 1
Kind of stream                           : Video
Kind of stream                           : Video
Stream identifier                        : 0
StreamOrder                              : 0
ID                                       : 2
ID                                       : 2
Format                                   : AVC
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format/Url                               : http://developers.videolan.org/x264.html
Commercial name                          : AVC
Format profile                           : Constrained Baseline@L3
Format settings                          : 1 Ref Frames
Format settings, CABAC                   : No
Format settings, CABAC                   : No
Format settings, Reference frames        : 1
Format settings, Reference frames        : 1 frame
Internet media type                      : video/H264
Muxing mode                              : Container [email protected]
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 6632640
Duration                                 : 1 h 50 min
Duration                                 : 1 h 50 min 32 s 640 ms
Duration                                 : 1 h 50 min
Duration                                 : 01:50:32.640
Duration                                 : 01:50:32:16
Duration                                 : 01:50:32.640 (01:50:32:16)
Bit rate                                 : 4163854
Bit rate                                 : 4 164 kb/s
Width                                    : 1280
Width                                    : 1 280 pixels
Height                                   : 720
Height                                   : 720 pixels
Sampled_Width                            : 1280
Sampled_Height                           : 720
Pixel aspect ratio                       : 1.000
Display aspect ratio                     : 1.778
Display aspect ratio                     : 16:9
Rotation                                 : 0.000
Frame rate mode                          : CFR
Frame rate mode                          : Constant
Frame rate                               : 25.000
Frame rate                               : 25.000 FPS
FrameRate_Num                            : 25
FrameRate_Den                            : 1
Frame count                              : 165816
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Chroma subsampling                       : 4:2:0
Bit depth                                : 8
Bit depth                                : 8 bits
Scan type                                : Progressive
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.181
Stream size                              : 3452167810
Stream size                              : 3.22 GiB (97%)
Stream size                              : 3 GiB
Stream size                              : 3.2 GiB
Stream size                              : 3.22 GiB
Stream size                              : 3.215 GiB
Stream size                              : 3.22 GiB (97%)
Proportion of this stream                : 0.96919
Language                                 : en
Language                                 : English
Language                                 : English
Language                                 : en
Language                                 : eng
Language                                 : en
Codec configuration box                  : avcC

Audio
Count                                    : 285
Count of stream of this kind             : 1
Kind of stream                           : Audio
Kind of stream                           : Audio
Stream identifier                        : 0
StreamOrder                              : 1
ID                                       : 1
ID                                       : 1
Format                                   : AAC
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Commercial name                          : AAC
Format_AdditionalFeatures                : LC
Codec ID                                 : mp4a-40-2
Duration                                 : 6632640
Duration                                 : 1 h 50 min
Duration                                 : 1 h 50 min 32 s 640 ms
Duration                                 : 1 h 50 min
Duration                                 : 01:50:32.640
Duration                                 : 01:50:32.640
Bit rate mode                            : CBR
Bit rate mode                            : Constant
Bit rate                                 : 127992
Bit rate                                 : 128 kb/s
Channel(s)                               : 2
Channel(s)                               : 2 channels
Channel positions                        : Front: L R
Channel positions                        : 2/0/0
Channel layout                           : L R
Samples per frame                        : 1024
Sampling rate                            : 44100
Sampling rate                            : 44.1 kHz
Samples count                            : 292499424
Frame rate                               : 43.066
Frame rate                               : 43.066 FPS (1024 SPF)
Frame count                              : 285644
Compression mode                         : Lossy
Compression mode                         : Lossy
Stream size                              : 106116365
Stream size                              : 101 MiB (3%)
Stream size                              : 101 MiB
Stream size                              : 101 MiB
Stream size                              : 101 MiB
Stream size                              : 101.2 MiB
Stream size                              : 101 MiB (3%)
Proportion of this stream                : 0.02979
Language                                 : en
Language                                 : English
Language                                 : English
Language                                 : en
Language                                 : eng
Language                                 : en

phineas-pta · 2023-09-28T16:50:09Z

phineas-pta
Sep 28, 2023

this: 2002-07-18 - Montreux Jazz Festival, Switerzland\bowie_montreux_02.mp4: No such file or directory

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Can't transcribe a file #1681

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Can't transcribe a file #1681

Uh oh!

Uh oh!

kanishknishar Sep 28, 2023

Replies: 1 comment

Uh oh!

phineas-pta Sep 28, 2023

kanishknishar
Sep 28, 2023

phineas-pta
Sep 28, 2023