depth-anything-tensorrt: Unable to create engine from onnx model

I’ve prepared the baseline onnx model, however, whenever I try and run depth-anything-tensorrt.exe, it outputs:

Loading model from models/depth_anything_vitb14.onnx...

and then, the program exits without any errors at all.

This is the command I’m using:

build/Release/depth-anything-tensorrt.exe models/depth_anything_vitb14.onnx video/davis_dolphins.mp4

I’m assuming that I am exporting the onnx model properly, however, just in case, I’ll upload a log. Here’s the command I used

python export.py --encoder vitb --load_from depth_anything_vitb14.pth --image_shape 3 518 518

onnxmodelexportlog.txt

Anyone have any idea why this isn’t working for me? Thanks.

CUDA: 11.6 TensortRT: 8.6.1.6 Windows: 11

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 40 (40 by maintainers)

Most upvoted comments

I see.

It works on 11.6 cuda version with nvidia gtx 1060 ?

I reinstalled everything and used cuda 11.8 for my gpu. I believe the problem was the cudnn installation.

I’ve figured it out. It was either my cuda cudnn or tensorrt installation that was the problem. I reinstalled everything and it works now.

Thanks for all your help!

Hmm sorry that is what I can suggest from my observation. I can’t guess without looking at it

I will try that, but again, I have been able to use my version of the onnxruntime with my current version of cuda with cuda acceleration just fine in the past with the exact same model through this repo.

Or premission. you tensorrt and opencv are in c folder will you try it as admin?