server: dlSym cannot locate method 'CreateExtension'

Triton Information What version of Triton are you using? 21.06

Are you using the Triton container or did you build it yourself? build my self

I have now recompiled the openvino back using openvino 2021.2 and need to load a custom operator that has been compiled to so lib, but got an error when loading so:

+---------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Model   | Version | Status                                                                                                                                                           |
+---------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| mylayer | 1       | UNAVAILABLE: Internal: ModelState::Create InferenceEngineException: dlSym cannot locate method 'CreateExtension': /data/custom_op_openvino/build/libt |
|         |         | emplate_extension.so: undefined symbol: CreateExtension                                                                                                          |
+---------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+

how to solve it?

About this issue

Original URL
State: closed
Created 3 years ago
Comments: 25 (10 by maintainers)

Most upvoted comments

I had open a new issue for perf tuning https://github.com/triton-inference-server/server/issues/3194

zhaohb on Aug 4, 2021

I had push my change https://github.com/triton-inference-server/openvino_backend/pull/27

zhaohb on Jul 31, 2021

@tanmayv25 I have solved the problem. and will submit a patch.

zhaohb on Jul 31, 2021

@tanmayv25 https://drive.google.com/drive/folders/1RPM2PjFMJaSdwDX-cpQ3gsqpTQ8B0fZf?usp=sharing you can get code from there.

mylayer.tar.gz is the code that can be executed correctly in the ov environment, it will generate the ngraph_custom_layer executable program, and he will generate the ov model model xml; the steps of compilation : 1).cd build 2).cmake … 3). make
mylayer_lib.tar.gz is the code for compiling the so library on the ov environment, it will generate libmylayer_cpu_extension.so; the steps of compilation : 1).cd build 2).cmake … 3). make
repo.tar.gz is the model repo of triton. had add libmylayer_cpu_extension.so to config.pbtxt, modify the path of libmylayer_cpu_extension.so according to the actual situation, and use triton to load the model will reproduce the problem

I hope it can be resolved as soon as possible, and I will continue to follow up, thanks very much.

zhaohb on Jul 23, 2021