Add Docker Installation to Whisper-Jax#138
Add Docker Installation to Whisper-Jax#138pourmand1376 wants to merge 2 commits intosanchit-gandhi:mainfrom
Conversation
|
Hello, thanks so much for that PR. Came just at the right time for me. Now came for this comment and saw that I am a little too late. The "Merging is blocked" was not there before. Hope my review helps. In case someone struggles with podman and GPU: With podman only CPU is used when starting up with podman compose-up, but when following this https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/1.14.1/cdi-support.html GPU is readily working. (started container by hand, don't know yet how to bring this into docker-compose) And another tip: it takes quite a while until the model is fetched (depending on internet speed. Almost 7GB). So comit the container locally when that is done, otherwise it is easy to loose the model and then wait again quite a while. |
Building a docker compatible Whisper-Jax literally took me a day.
None of the methods recommended by Jax Team worked for GPU compatible installation. So, I used a nightly build from NVIDIA Jax and installed all your dependencies.
Also, some dependencies were not available in
setup.py. I have added a list of complete dependencies inrequirements.txt.