TensorRT: Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[Unsqueeze_93...Softmax_2088]}
I use trtexec (TensorRT 8.2.4.2 GA CUDA11.4) to convert my onnx model to trt engine, It show the error below. I tried TensorRT8.4EA Cuda11.5, the transform is OK. and I check the support operator in 8.2GA includes Unsequeeze Softmax
, and it’s same with that of 8.4EA, So I don’t know why this error happens?
[04/12/2022-11:30:51] [V] [TRT] *************** Autotuning format combination: Bool(450,1), Bool(22500,50,1), Float(202500,450,9,1), Float(900,2,1) -> Float(512,1), Float(3,1) ***************
[04/12/2022-11:30:51] [V] [TRT] --------------- Timing Runner: {ForeignNode[Unsqueeze_93...Softmax_2088]} (Myelin)
[04/12/2022-11:30:51] [W] [TRT] Skipping tactic 0 due to insuficient memory on requested size of 26931712 detected for tactic 0.
[04/12/2022-11:30:51] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: inf
[04/12/2022-11:30:51] [E] Error[10]: [optimizer.cpp::computeCosts::2011] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[Unsqueeze_93...Softmax_2088]}.)
[04/12/2022-11:30:51] [E] Error[2]: [builder.cpp::buildSerializedNetwork::609] Error Code 2: Internal Error (Assertion enginePtr != nullptr failed. )
[04/12/2022-11:30:51] [E] Engine could not be created from network
[04/12/2022-11:30:51] [E] Building engine failed
[04/12/2022-11:30:51] [E] Failed to create engine from model.
[04/12/2022-11:30:51] [E] Engine set up failed
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 23
I have the similar problem, but fixed by adding /path/to/TensorRT-8.2.4.2/lib to LD_LIBRARY_PATH