faster-whisper: Docker error "Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory"
Hi. I have a container which has CUDA and cudnn (nvidia/cuda:11.8.0-base-ubuntu22.04).
But when I want to use it in inference mode, I have a problem:
Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory
About this issue
- Original URL
- State: closed
- Created 3 years ago
- Comments: 18
Commits related to this issue
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 — committed to ibombonato/whisperX by ibombonato 2 years ago
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 Co-authored by: Icaro Bombonato <ibombonato... — committed to Barabazs/whisperX by Barabazs 2 years ago
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 Co-authored-by: Icaro Bombonato <ibombonato... — committed to Barabazs/whisperX by Barabazs 2 years ago
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 Co-authored-by: Icaro Bombonato <ibombonato... — committed to m-bain/whisperX by Barabazs 2 years ago
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 Co-authored-by: Icaro Bombonato <ibombonato... — committed to opus-pro/whisperX by Barabazs 2 years ago
- feat: sync with parent repo (#2) * local vad model * move model to assets * Remove typo in error message * Fix link in README.md * Added Romanian phoneme-based ASR model (#791) Co-auth... — committed to opus-pro/whisperX by yuki-opus 2 years ago
- fix: Force ctranslate to version 4.4.0 Force ctranslate to version 4.4.0 due libcudnn_ops_infer.so.8: https://github.com/SYSTRAN/faster-whisper/issues/729 Co-authored-by: Icaro Bombonato <ibombonato... — committed to fika-dev/x-custom by Barabazs 2 years ago
This issue was resolved by installing
libcudnn8andlibcudnn8-devon ubuntu 22.04 with cuda12@cod3r0k , ok. My CUDA version in host machine is 12.0. Therefor I used image
nvidia/cuda:12.0.0-devel-ubuntu20.04. Below is a simple example for FW Dockerfile:infer.py
Running:
Hope it’s helpful for you.
Thank you! It works for me!
Many thanks.
Currently, I am facing an issue that is not resolved yet. It’s working fine in non-docker, but in docker, it’s not working. Can you please share the docker file that you have used to run it successfully? @trungkienbkhn