vllm: [Bug]: When using the latest 0.6.3, No module named 'vllm._version' appears

Your current environment

The output of `python collect_env.py`
Your output of `python collect_env.py` here

Model Input Dumps

No response

🐛 Describe the bug

Start service: vllm serve /models/huggingface.co/meta-llama/Llama-3-8b-hf/ A warning appears: /usr/local/lib/python3.10/dist-packages/vllm/connections.py:8: RuntimeWarning: Failed to read commit hash: No module named 'vllm._version' from vllm.version import __version__ as VLLM_VERSIO

Before submitting a new issue…

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

About this issue

  • Original URL
  • State: open
  • Created 2 years ago
  • Reactions: 10
  • Comments: 16 (1 by maintainers)

Most upvoted comments

I use the following command to solve this issue:

pip install “vllm>=0.4.3,<0.6.4”

vllm==0.6.3 not work 0.5.4 is work for me

I will make a patch release once https://github.com/vllm-project/vllm/pull/9375 merged

I also have same problem. However 0.5.4 is not work for me. And “AssertionError: The installed transformers version doesn’t support ulysses patch. Please install a version between 4.45.0 and 4.50.0 to use this ulysses feature.”

I suggest, you should use : pip install “transformers>=4.45.0,<=4.50.0”

I use the following command to solve this issue:

pip install "vllm>=0.4.3,<0.6.4"