About yolov5-rt-stack/depnt/tensorrt

[leeyunhome]

Hello, @zhiqwang

Built environment information
Graphics card: gtx3080
OS: ubuntu18.04
python: anaconda

(yolov5_latest_env) aiserver@aiserver-H110-D3:/media/aiserver/data/coding/github_repository/yolov5-rt-stack/deployment/tensorrt/build$ nvidia-smi 

Tue Jul 19 08:14:57 2022       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 495.29.05    Driver Version: 495.29.05    CUDA Version: 11.5     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:01:00.0  On |                  N/A |
|  0%   45C    P8    26W / 320W |    269MiB / 10016MiB |     11%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      1108      G   /usr/lib/xorg/Xorg                166MiB |
|    0   N/A  N/A      1777      G   /usr/bin/gnome-shell               72MiB |
|    0   N/A  N/A      3117      G   ...235741681135746328,131072       12MiB |
|    0   N/A  N/A     23598      G   ...AAAAAAAAA= --shared-files       13MiB |
+-----------------------------------------------------------------------------+

(yolov5_latest_env) aiserver@aiserver-H110-D3:/media/aiserver/data/coding/github_repository/yolov5-rt-stack/deployment/tensorrt/build$ conda list
# packages in environment at /home/aiserver/anaconda3/envs/yolov5_latest_env:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
asttokens                 2.0.5                    pypi_0    pypi
backcall                  0.2.0                    pypi_0    pypi
ca-certificates           2022.4.26            h06a4308_0  
certifi                   2022.6.15        py38h06a4308_0  
charset-normalizer        2.1.0                    pypi_0    pypi
commonmark                0.9.1                    pypi_0    pypi
cycler                    0.11.0                   pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
executing                 0.8.3                    pypi_0    pypi
flatbuffers               2.0                      pypi_0    pypi
idna                      3.3                      pypi_0    pypi
ipython                   8.4.0                    pypi_0    pypi
jedi                      0.18.1                   pypi_0    pypi
kiwisolver                1.4.3                    pypi_0    pypi
ld_impl_linux-64          2.38                 h1181459_1  
libffi                    3.3                  he6710b0_2  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libstdcxx-ng              11.2.0               h1234567_1  
matplotlib-inline         0.1.3                    pypi_0    pypi
ncurses                   6.3                  h5eee18b_3  
nvidia-cublas-cu11        2022.4.8                 pypi_0    pypi
nvidia-cublas-cu117       11.10.1.25               pypi_0    pypi
nvidia-cuda-runtime-cu11  2022.4.25                pypi_0    pypi
nvidia-cuda-runtime-cu117 11.7.60                  pypi_0    pypi
nvidia-cudnn-cu11         2022.5.19                pypi_0    pypi
nvidia-cudnn-cu116        8.4.0.27                 pypi_0    pypi
nvidia-tensorrt           8.4.1.5                  pypi_0    pypi
onnx                      1.12.0                   pypi_0    pypi
onnx-graphsurgeon         0.3.19                   pypi_0    pypi
onnx-simplifier           0.4.0                    pypi_0    pypi
onnxruntime-gpu           1.11.1                   pypi_0    pypi
onnxsim-no-ort            0.4.0                    pypi_0    pypi
openssl                   1.1.1q               h7f8727e_0  
packaging                 21.3                     pypi_0    pypi
pandas                    1.4.3                    pypi_0    pypi
parso                     0.8.3                    pypi_0    pypi
pexpect                   4.8.0                    pypi_0    pypi
pickleshare               0.7.5                    pypi_0    pypi
pip                       22.1.2           py38h06a4308_0  
prompt-toolkit            3.0.30                   pypi_0    pypi
psutil                    5.9.1                    pypi_0    pypi
ptyprocess                0.7.0                    pypi_0    pypi
pure-eval                 0.2.2                    pypi_0    pypi
pygments                  2.12.0                   pypi_0    pypi
pyparsing                 3.0.9                    pypi_0    pypi
python                    3.8.13               h12debd9_0  
python-dateutil           2.8.2                    pypi_0    pypi
pytz                      2022.1                   pypi_0    pypi
pyyaml                    6.0                      pypi_0    pypi
readline                  8.1.2                h7f8727e_1  
requests                  2.28.1                   pypi_0    pypi
rich                      12.5.1                   pypi_0    pypi
scipy                     1.8.1                    pypi_0    pypi
seaborn                   0.11.2                   pypi_0    pypi
setuptools                61.2.0           py38h06a4308_0  
six                       1.16.0                   pypi_0    pypi
sqlite                    3.38.5               hc218d9a_0  
stack-data                0.3.0                    pypi_0    pypi
tabulate                  0.8.10                   pypi_0    pypi
thop                      0.1.1-2207130030          pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
torch                     1.10.0+cu113             pypi_0    pypi
torchvision               0.11.1+cu113             pypi_0    pypi
traitlets                 5.3.0                    pypi_0    pypi
typing-extensions         4.3.0                    pypi_0    pypi
urllib3                   1.26.10                  pypi_0    pypi
wcwidth                   0.2.5                    pypi_0    pypi
werkzeug                  2.1.2                    pypi_0    pypi
wheel                     0.37.1             pyhd3eb1b0_0  
xz                        5.2.5                h7f8727e_1  
yolort                    0.6.3                    pypi_0    pypi
zipp                      3.8.1                    pypi_0    pypi
zlib                      1.2.12               h7f8727e_2 

(yolov5_latest_env) aiserver@aiserver-H110-D3:/media/aiserver/data/coding/github_repository/yolov5-rt-stack/deployment/tensorrt/build$ cmake ..
-- The CXX compiler identification is GNU 7.5.0
-- The CUDA compiler identification is NVIDIA 11.5.119
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working CUDA compiler: /usr/local/cuda-11.5/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-11.5/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- TENSORRT_DIR: OFF
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
  **Could NOT find CUDA: Found unsuitable version "11.5", but required is exact**
  version "11.1" (found /usr/local/cuda-11.5)
Call Stack (most recent call first):
  /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:376 (_FPHSA_FAILURE_MESSAGE)
  /usr/share/cmake-3.10/Modules/FindCUDA.cmake:1080 (find_package_handle_standard_args)
  /usr/local/lib/cmake/opencv4/OpenCVConfig.cmake:86 (find_package)
  /usr/local/lib/cmake/opencv4/OpenCVConfig.cmake:108 (find_host_package)
  CMakeLists.txt:7 (find_package)


-- Configuring incomplete, errors occurred!
See also "/media/aiserver/data/coding/github_repository/yolov5-rt-stack/deployment/tensorrt/build/CMakeFiles/CMakeOutput.log".
See also "/media/aiserver/data/coding/github_repository/yolov5-rt-stack/deployment/tensorrt/build/CMakeFiles/CMakeError.log".
(yolov5_latest_env) aiserver@aiserver-H110-D3:/media/aiserver/data/coding/github_repository/yolov5-rt-stack/depnt/tensorrt/build$ 

Could you tell me how to resolve this issue?

Thank you.

UPDATE Format by Zhiqiang

[zhiqwang]

Hi @leeyunhome ,

Seems that there're some problems when installing CUDA and TensorRT, we recommend using docker provided by PyTorch to install TensorRT environment.

Check out https://zhiqwang.com/yolov5-rt-stack/notebooks/onnx-graphsurgeon-inference-tensorrt.html#TensorRT-Installation-Instructions for more detial about installing TensorRT.