Closed
Description
Whisper.cpp now supports CUDA. While it's really annoying to setup CUDA and its drivers, it should give a nice performance boost for Windows and Linux PCs with Nvidia cards.
I want to make it optional. Probably best way to do that is to compile one .dll with CUDA support and one without. I would need to figure out how to switch between them in runtime.
Also it will probably be smart to add fallback to CPU when no CUDA available.