vllm: [Bug]: ailed to import from vllm._C with ImportError('/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj')

Your current environment

The output of `python collect_env.py`

import vllm WARNING 06-13 11:42:20 _custom_ops.py:11] Failed to import from vllm._C with ImportError(‘/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj’)

🐛 Describe the bug

import vllm WARNING 06-13 11:42:20 _custom_ops.py:11] Failed to import from vllm._C with ImportError(‘/usr/local/lib/python3.8/dist-packages/vllm/_C.abi3.so: undefined symbol: _ZN5torch7LibraryC1ENS0_4KindESsSt8optionalIN3c1011DispatchKeyEEPKcj’)

Does the pip install vllm supports torch2.3.0? If not, why not mentioned it in README?

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 26 (7 by maintainers)

Most upvoted comments

Same problem when installing vllm on Kaggle

Kaggle seems to have bad installs of some dependencies. For me, forcing an upgrade of torchvision to 0.19.1 which is then subsequently downgraded back to 0.19 when installing vllm did the trick:

!pip install torchvision==0.19.1 !pip install vllm

cc @bnellnm , this should be relevant with the recent change of binding system.