Support for AMD GPUs

[rishikanthc]

This thread tracks the development of adding rocm support to run transcription on AMD GPUs

[SpirusNox]

I think I may have found the issue. I much have fat fingered it when I put it in:
Line 107-109 of whisperx.go

if device == "rocm" {
    device = "cuda"  
}

I just pushed a new commit to the branch. Let me know if it works.

[MadDogTen]

I updated my "working" branch with your fix and rebuilt, and again tested the same command with both 'cuda' and 'rocm'. 'cuda' was the same (RuntimeError: CUDA failed with error CUDA driver version is insufficient for CUDA runtime version), and the 'rocm':
uv run whisperx "/app/data/uploads/9cd7adc9-7b6d-482d-9a35-59d64cd5e51c.webm" --device rocm

INFO:speechbrain.utils.quirks:Applied quirks (see `speechbrain.utils.quirks`): [allow_tf32, disable_jit_profiling]
INFO:speechbrain.utils.quirks:Excluded quirks specified by the `SB_DISABLE_QUIRKS` environment (comma-separated list): []
Traceback (most recent call last):
  File "/app/whisperx-env/WhisperX/.venv/bin/whisperx", line 10, in <module>
    sys.exit(cli())
             ^^^^^
  File "/app/whisperx-env/WhisperX/whisperx/__main__.py", line 85, in cli
    transcribe_task(args, parser)
  File "/app/whisperx-env/WhisperX/whisperx/transcribe.py", line 124, in transcribe_task
    model = load_model(
            ^^^^^^^^^^^
  File "/app/whisperx-env/WhisperX/whisperx/asr.py", line 336, in load_model
    model = model or WhisperModel(whisper_arch,
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/whisperx-env/WhisperX/.venv/lib/python3.12/site-packages/faster_whisper/transcribe.py", line 647, in __init__
    self.model = ctranslate2.models.Whisper(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: unsupported device rocm

[MadDogTen]

Any progress on figuring out the issue, or just currently busy irl / with other stuff?