TensorRT-LLM: Build TensorRT-LLM occur error
run the command “python3 ./scripts/build_wheel.py --trt_root /usr/local/tensorrt”,occur error, detail info follow: $python3 ./scripts/build_wheel.py --trt_root /opt/conda/lib/python3.8/site-packages/tensorrt Looking in indexes: https://artifacts.antgroup-inc.cn/simple/, https://pypi.ngc.nvidia.com Requirement already satisfied: build in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 1)) (1.0.3) Requirement already satisfied: torch in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 2)) (2.0.1) Requirement already satisfied: transformers==4.31.0 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 3)) (4.31.0) Requirement already satisfied: diffusers==0.15.0 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 4)) (0.15.0) Requirement already satisfied: accelerate==0.20.3 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 5)) (0.20.3) Requirement already satisfied: colored in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 6)) (1.4.4) Requirement already satisfied: polygraphy in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 7)) (0.49.0) Requirement already satisfied: onnx>=1.12.0 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 8)) (1.14.1) Requirement already satisfied: mpi4py in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 9)) (3.1.4) Requirement already satisfied: tensorrt>=8.6.0 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 10)) (9.1.0.post11.dev4) Requirement already satisfied: numpy in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 11)) (1.23.5) Requirement already satisfied: cuda-python==12.2.0 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 12)) (12.2.0) Requirement already satisfied: sentencepiece>=0.1.99 in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 13)) (0.1.99) Requirement already satisfied: wheel in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 14)) (0.38.4) Requirement already satisfied: lark in /opt/conda/lib/python3.8/site-packages (from -r requirements.txt (line 15)) (1.1.8) Requirement already satisfied: regex!=2019.12.17 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (2023.5.5) Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (0.16.4) Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (0.13.3) Requirement already satisfied: safetensors>=0.3.1 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (0.3.2) Requirement already satisfied: pyyaml>=5.1 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (6.0) Requirement already satisfied: filelock in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (3.12.2) Requirement already satisfied: requests in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (2.29.0) Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (23.0) Requirement already satisfied: tqdm>=4.27 in /opt/conda/lib/python3.8/site-packages (from transformers==4.31.0->-r requirements.txt (line 3)) (4.65.0) Requirement already satisfied: importlib-metadata in /opt/conda/lib/python3.8/site-packages (from diffusers==0.15.0->-r requirements.txt (line 4)) (6.6.0) Requirement already satisfied: Pillow in /opt/conda/lib/python3.8/site-packages (from diffusers==0.15.0->-r requirements.txt (line 4)) (9.5.0) Requirement already satisfied: psutil in /opt/conda/lib/python3.8/site-packages (from accelerate==0.20.3->-r requirements.txt (line 5)) (5.9.0) Requirement already satisfied: cython in /opt/conda/lib/python3.8/site-packages (from cuda-python==12.2.0->-r requirements.txt (line 12)) (0.29.36) Requirement already satisfied: tomli>=1.1.0 in /opt/conda/lib/python3.8/site-packages (from build->-r requirements.txt (line 1)) (2.0.1) Requirement already satisfied: pyproject_hooks in /opt/conda/lib/python3.8/site-packages (from build->-r requirements.txt (line 1)) (1.0.0) Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.7.99) Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (8.5.0.96) Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.4.0.1) Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (10.9.0.58) Requirement already satisfied: jinja2 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (3.1.2) Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.10.3.66) Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (10.2.10.91) Requirement already satisfied: networkx in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (3.1) Requirement already satisfied: triton==2.0.0 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (2.0.0) Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.7.101) Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.7.4.91) Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.7.99) Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (2.14.3) Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (11.7.91) Requirement already satisfied: sympy in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (1.12) Requirement already satisfied: typing-extensions in /opt/conda/lib/python3.8/site-packages (from torch->-r requirements.txt (line 2)) (4.5.0) Requirement already satisfied: setuptools in /opt/conda/lib/python3.8/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch->-r requirements.txt (line 2)) (67.8.0) Requirement already satisfied: cmake in /opt/conda/lib/python3.8/site-packages (from triton==2.0.0->torch->-r requirements.txt (line 2)) (3.26.3) Requirement already satisfied: lit in /opt/conda/lib/python3.8/site-packages (from triton==2.0.0->torch->-r requirements.txt (line 2)) (16.0.5) Requirement already satisfied: protobuf>=3.20.2 in /opt/conda/lib/python3.8/site-packages (from onnx>=1.12.0->-r requirements.txt (line 8)) (4.24.4) Requirement already satisfied: fsspec in /opt/conda/lib/python3.8/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers==4.31.0->-r requirements.txt (line 3)) (2023.5.0) Requirement already satisfied: zipp>=0.5 in /opt/conda/lib/python3.8/site-packages (from importlib-metadata->diffusers==0.15.0->-r requirements.txt (line 4)) (3.15.0) Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.8/site-packages (from jinja2->torch->-r requirements.txt (line 2)) (2.1.3) Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/lib/python3.8/site-packages (from requests->transformers==4.31.0->-r requirements.txt (line 3)) (2.0.4) Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.8/site-packages (from requests->transformers==4.31.0->-r requirements.txt (line 3)) (2023.5.7) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/conda/lib/python3.8/site-packages (from requests->transformers==4.31.0->-r requirements.txt (line 3)) (1.26.16) Requirement already satisfied: idna<4,>=2.5 in /opt/conda/lib/python3.8/site-packages (from requests->transformers==4.31.0->-r requirements.txt (line 3)) (3.4) Requirement already satisfied: mpmath>=0.19 in /opt/conda/lib/python3.8/site-packages (from sympy->torch->-r requirements.txt (line 2)) (1.3.0) WARNING: Running pip as the ‘root’ user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv gmake: Makefile: No such file or directory gmake: *** No rule to make target `Makefile’. Stop. Traceback (most recent call last): File “./scripts/build_wheel.py”, line 248, in <module> main(**vars(args)) File “./scripts/build_wheel.py”, line 152, in main build_run( File “/opt/conda/lib/python3.8/subprocess.py”, line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'cmake --build . --config Release --parallel 14 --target tensorrt_llm tensorrt_llm_static nvinfer_plugin_tensorrt_llm th_common ’ returned non-zero exit status 2.
About this issue
- Original URL
- State: closed
- Created 8 months ago
- Comments: 18
TensorRT-LLM definitely requires CUDA 12.2.