onnxruntime: failed to install onnxruntime-gpu on Jetson Nano with the latest image (Jetpack 4.4.1)

Describe the bug failed to install onnxruntime-gpu PyPi package on Jetson Nano device with the latest image (Jetpack 4.4.1)

Urgency ASAP

System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux gubert-jetson-ha 4.9.140-tegra #1 SMP PREEMPT Tue Oct 27 21:02:37 PDT 2020 aarch64 aarch64 aarch64 GNU/Linux
ONNX Runtime installed from (source or binary): pip3 install onnxruntime-gpu==1.4.0
ONNX Runtime version: 1.4.0
Python version: 3.6.9
Visual Studio version (if applicable):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version: CUDA Version 10.2.89
GPU model and memory: Jetson Nano 4GB

To Reproduce

Describe steps/code to reproduce the behavior.
Attach the ONNX model to the issue (where applicable) to expedite investigation.

pip3 install onnxruntime-gpu
Defaulting to user installation because normal site-packages is not writeable
ERROR: Could not find a version that satisfies the requirement onnxruntime-gpu
ERROR: No matching distribution found for onnxruntime-gpu

Expected behavior A clear and concise description of what you expected to happen. the package should be installed as onnxruntime==1.4.0 does successfully

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here. If the issue is about a particular model, please share the model details as well to facilitate debugging.

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 27 (7 by maintainers)

Most upvoted comments

Please note that we have ORT 1.6.0 GPU python (3.6, 3.7, 3.8) packages for Jetpack 4.4/4.4.1 now! https://elinux.org/Jetson_Zoo#ONNX_Runtime

jywu-msft on Dec 28, 2020

found and answer how to install here: https://elinux.org/Jetson_Zoo#ONNX_Runtime

guybartal on Dec 13, 2020

@dav-ell Hi, I can install onnxruntime-gpu 1.10.0 on my nano with Jetpack version 4.5-b129

# Download pip wheel from location mentioned above
wget https://nvidia.box.com/shared/static/jy7nqva7l88mq9i8bw3g3sklzf4kccn2.whl -O onnxruntime_gpu-1.10.0-cp36-cp36m-linux_aarch64.whl

Use this command to install .whl

python3 -m pip install onnxruntime_gpu-1.10.0-cp36-cp36m-linux_aarch64.whl

Instead of pip3 install onnxruntime_gpu-1.10.0-cp36-cp36m-linux_aarch64.whl

patrick620 on Apr 19, 2022

I also can’t run onnxruntime-gpu for Jetpack 5.1.1 on Jetson orin nano developer kit. Onnxruntime-gpu 1.12.1 for Jetpack 5.0 does not see the gpu and only works for cpu,

ErenCaldiran on Apr 28, 2023

Thanks @patrick620! That did the trick. Fyi to those interested, TensorrtExecutionProvider is not supported using the above method.

dav-ell on Apr 23, 2022

Try following the link jywu-msft posted: https://elinux.org/Jetson_Zoo#ONNX_Runtime and download the pip-wheel appropriate to the python version (python3 --version) you are using and run the pip3 install onnxruntim… command. Worked for me on a Jetson Nano.

weosk on Dec 7, 2021

im trying to install onnxruntime on my jetson nano but im running into an issue where im installing like above, but protobuf wont install causing the entire install to fail. the error im getting is : protobuf requires Python ‘>=3.7’ but the running python is 3.6.9 and correct me if im wrong, but jetpack needs python3.6 ? so how do i get around this error? thanks!

you can install a different version of python on the jetson. e.g. apt install python3.7

I just ran into this as well, the wheel referenced in the docs seems to be broken

dlangerm on Jun 28, 2022

Still getting an error with the .whl file, tried both on python 3.9.6, on a Jetson Nano 4G

ERROR: onnxruntime_gpu-1.8.0-cp36-cp36m-linux_aarch64.whl is not a supported wheel on this platform.

everdrone on Aug 19, 2021

im trying to install onnxruntime on my jetson nano but im running into an issue where im installing like above, but protobuf wont install causing the entire install to fail.

the error im getting is : protobuf requires Python ‘>=3.7’ but the running python is 3.6.9

and correct me if im wrong, but jetpack needs python3.6 ? so how do i get around this error? thanks!

you can install a different version of python on the jetson. e.g. apt install python3.7

jywu-msft on Jun 21, 2022

@weosk’s method worked for me, but I’m getting an error trying to import the library:

import onnxruntime as ort

gives

ModuleNotFoundError: No module named 'onnxruntime'

Is there a different way to import?

dav-ell on Apr 15, 2022