CUDA support for wav2vec2

[rafael844]

Hi, im using last snapshot so I can test remote wav2vec2, we have an Nvidia Quadro P1000, but iped cant see any CUDA, then uses the cpu to process.
Is there any iped config we should set the CUDA?

deviceQuery.exe recognizes it

[lfcnassif]

First you need to install your GPU drivers, CUDA 11.7 or CUDA 11.8 and pytorch into IPED's python. Default pytorch doesn't come with GPU support, you need to install it using one of these commands https://pytorch.org/get-started/locally/
Then you will need to install cuDNN

[lfcnassif]

I just remembered you need to enable the audio transcription option in IPEDConfig.txt to start the service (this is not on the Wiki...). I'll commit a small change to don't need this setting.

[rafael844]

Yes, that was my fault, becouse of it I deleted the post. When I set the snapshot again I only set AudioTranscriptConfig.txt. When I set true the audio transcription in IPEDConfig.txt it worked very well. My process decreased from 3 hours (8 cores CPU) to 15 minutes (GPU Quadro P1000 with 4GB), using a low GPU.
Thank you.

[lfcnassif]

Are you using a smaller model or the large one?

[rafael844]

smaller, when I try jonatasgrosman/wav2vec2-xls-r-1b-portuguese, IPED sets model=CPU automatically.

[lfcnassif]

Right, it tries to load on GPU, if it fails (e.g. insufficient memory), it falls back to CPU.