RuntimeError: CUDA failed with error CUDA driver version is insufficient for CUDA runtime version

[SwAt1563]

---

Issue Summary:
I'm attempting to run faster-whisper with GPU support on my device, which has CUDA 12.6 installed. The following package versions are being used:

• faster-whisper==1.0.3
• ctranslate2==4.4.0
• wyoming==1.5.3

The model runs successfully on the CPU; however, it does not utilize the GPU as expected. I am looking for a solution to enable GPU acceleration for faster-whisper using CUDA 12.6.

[jhj0517]

If you're using docker you can try changing

faster-whisper/docker/Dockerfile

Line 5 in 814472f

RUN pip3 install faster-whisper

into

 RUN pip3 install faster-whisper torch --index-url https://download.pytorch.org/whl/cu124

Currently there's a strict version matrix between torch and faster-whisper : #1086 (comment)

[SwAt1563]

Thank you for your guidance, but it still doesn't work.