onnxruntime: OnnxRuntime_test_all fails when building with TensorRT

I followed the instructions described here to build with TensorRT and got the following error

1:   YOU HAVE 4 DISABLED TESTS
1:
1:
1: ----- MEMORY LEAKS: 216 bytes of memory leaked in 6 allocations
1/3 Test #1: onnxruntime_test_all .............***Failed  229.37 sec
test 2
    Start 2: onnx_test_pytorch_converted

2: Test command: C:\Users\AzureUser\onnxruntime\build\Windows\Debug\Debug\onnx_test_runner.exe "C:/Users/AzureUser/onnxruntime/cmake/external/onnx/onnx/backend/test/data/pytorch-converted"
2: Test timeout computed to be: 10000000
2: 2020-09-20 16:46:09.6963656 [E:onnxruntime:Default, testcase_driver.cc:41 onnxruntime::test::TestCaseDriver::RunParallel] Running tests in parallel: at most 6 models at any time
2: 2020-09-20 16:46:17.2699163 [E:onnxruntime:Default, testcase_driver.cc:63 onnxruntime::test::TestCaseDriver::RunModelsAsync] Running tests finished. Generating report
2: result:
2:      Models: 57
2:      Total test cases: 57
2:              Succeeded: 57
2:              Not implemented: 0
2:              Failed: 0
2:      Stats by Operator type:
2:              Not implemented(0):
2:              Failed:
2: Failed Test Cases:
2/3 Test #2: onnx_test_pytorch_converted ......   Passed    9.40 sec
test 3
    Start 3: onnx_test_pytorch_operator

3: Test command: C:\Users\AzureUser\onnxruntime\build\Windows\Debug\Debug\onnx_test_runner.exe "C:/Users/AzureUser/onnxruntime/cmake/external/onnx/onnx/backend/test/data/pytorch-operator"
3: Test timeout computed to be: 10000000
3: 2020-09-20 16:46:18.6645857 [E:onnxruntime:Default, testcase_driver.cc:41 onnxruntime::test::TestCaseDriver::RunParallel] Running tests in parallel: at most 6 models at any time
3: 2020-09-20 16:46:22.0578970 [E:onnxruntime:Default, testcase_driver.cc:63 onnxruntime::test::TestCaseDriver::RunModelsAsync] Running tests finished. Generating report
3: result:
3:      Models: 24
3:      Total test cases: 24
3:              Succeeded: 24
3:              Not implemented: 0
3:              Failed: 0
3:      Stats by Operator type:
3:              Not implemented(0):
3:              Failed:
3: Failed Test Cases:
3/3 Test #3: onnx_test_pytorch_operator .......   Passed    4.78 sec

67% tests passed, 1 tests failed out of 3

Total Test time (real) = 243.60 sec

The following tests FAILED:
          1 - onnxruntime_test_all (Failed)
Errors while running CTest
Traceback (most recent call last):
  File "C:\Users\AzureUser\onnxruntime\\tools\ci_build\build.py", line 1800, in <module>
    sys.exit(main())
  File "C:\Users\AzureUser\onnxruntime\\tools\ci_build\build.py", line 1741, in main
    run_onnxruntime_tests(args, source_dir, ctest_path, build_dir, configs)
  File "C:\Users\AzureUser\onnxruntime\\tools\ci_build\build.py", line 1195, in run_onnxruntime_tests
    run_subprocess(ctest_cmd, cwd=cwd, dll_path=dll_path)
  File "C:\Users\AzureUser\onnxruntime\\tools\ci_build\build.py", line 446, in run_subprocess
    env=my_env, shell=shell)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Anaconda3_64\lib\subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['C:\\Program Files\\CMake\\bin\\ctest.EXE', '--build-config', 'Debug', '--verbose']' returned non-zero exit status 8.

System information

OS Platform and Distribution (e.g., Linux Ubuntu 18.04): WS 2016 Visual Studio : 2017 Community ONNX Runtime installed from (source or binary): source ONNX Runtime version: 1.7 Python version: 3.7 CUDA version: 10.1 cuDNN version: 7.6.5 GPU card: P40

Thanks in advance

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 18 (8 by maintainers)

Most upvoted comments

@snnn Here is the log from Visual Studio: vs.log

The commit-id is 5de47affb14bbb7e0cea35c0f12c6b7f0436025e which is v1.5.1.