CTranslate2: WHISPER: Could not load library libcublasLt.so.12. Error: libcublasLt.so.12: cannot open shared object file: No such file or directory

Hi, I’m trying to run a Whisper model with the script I found in the docs on GPU. However I get this error when generate() is called:

Could not load library libcublasLt.so.12. Error: libcublasLt.so.12: cannot open shared object file: No such file or directory

Do I need CUDA 12?

I’ve just made the following chage in the script: model = ctranslate2.models.Whisper(sys.argv[1], device="cuda")

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Comments: 18

Most upvoted comments

Thanks for the confirmation.

@anderleich You should have the same issue so I’m closing this issue.