GPU Docker image support (H200, A6000, A6000 Pro, L40S)

[flefevre]

Hello 👋

First of all, thank you for Scriberr, it’s a very interesting project.

I wanted to ask whether you are planning to provide official Docker images with GPU support, especially for more recent or professional NVIDIA GPUs, such as:

• NVIDIA H200

• NVIDIA RTX A6000

• NVIDIA RTX A6000 Pro

• NVIDIA L40S

Having a prebuilt Docker image compatible with these GPUs (CUDA / cuDNN properly configured) would be extremely helpful for deployment in production and on HPC or cloud environments.

If this is already planned, do you have a rough timeline?

Thanks in advance for your work and your time!

Best regards,

[rishikanthc]

Support for the newer gpus is coming soon. A contributor submitted a PR for this which has been merged. The new images will be out in the next release which should be sometime this week.
Thank you for your interest in the project and hope you enjoy using it Scriberr.