vllm: [Bug]: When using the latest 0.6.3, No module named 'vllm._version' appears
Your current environment
The output of `python collect_env.py`
Your output of `python collect_env.py` here
Model Input Dumps
No response
🐛 Describe the bug
Start service: vllm serve /models/huggingface.co/meta-llama/Llama-3-8b-hf/
A warning appears:
/usr/local/lib/python3.10/dist-packages/vllm/connections.py:8: RuntimeWarning: Failed to read commit hash: No module named 'vllm._version' from vllm.version import __version__ as VLLM_VERSIO
Before submitting a new issue…
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
About this issue
- Original URL
- State: open
- Created 2 years ago
- Reactions: 10
- Comments: 16 (1 by maintainers)
vllm==0.6.3 not work 0.5.4 is work for me
I will make a patch release once https://github.com/vllm-project/vllm/pull/9375 merged
I suggest, you should use : pip install “transformers>=4.45.0,<=4.50.0”
+1
I use the following command to solve this issue:
+1