vllm: [Bug]: ailed to import from vllm._C with ImportError('/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj')
Your current environment
The output of `python collect_env.py`
import vllm WARNING 06-13 11:42:20 _custom_ops.py:11] Failed to import from vllm._C with ImportError(‘/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj’)
🐛 Describe the bug
import vllm WARNING 06-13 11:42:20 _custom_ops.py:11] Failed to import from vllm._C with ImportError(‘/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj’)
Does the pip install vllm supports torch2.3.0? If not, why not mentioned it in README?
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 26 (7 by maintainers)
Kaggle seems to have bad installs of some dependencies. For me, forcing an upgrade of torchvision to 0.19.1 which is then subsequently downgraded back to 0.19 when installing vllm did the trick:
!pip install torchvision==0.19.1 !pip install vllm
cc @bnellnm , this should be relevant with the recent change of binding system.