alpa: Distributed Generation Script - benchmark_text_gen.py - CUDA related error
HI,
While running the ray and benchmark_text_gen.py
script, I see an error related to CUDA (snapshot below). I have verified the CUDA, CUDNN versions and GPU info and everything looks fine. Any possible hints on this.
cuda: 11.3 cudnn: 8.2 gcc: 11.3.0
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 16 (8 by maintainers)
@zhisbug Thanks a lot for all the quick guidance and issue resolution steps. I am able to run the model without any errors. Thanks again. Appreciate your timely support!
@BalajiAJ See this PR for more information: https://github.com/alpa-projects/alpa/pull/589#event-6929171772