Skip to content

bash: tao-converter: command not found #17

@MeHelge

Description

@MeHelge

Hi,
i am getting this error after installing TensorRT OSS 22.02.
What am I doing wrong?

nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

`nvidia-smi
Thu Nov 23 08:56:52 2023
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 2050 On | 00000000:01:00.0 Off | N/A |
| N/A 48C P5 3W / 20W | 1224MiB / 4096MiB | 16% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
+---------------------------------------------------------------------------------------+`

NAME="Ubuntu"
VERSION="20.04.6 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.6 LTS"
VERSION_ID="20.04"

`in_static.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/splitPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/voxelGeneratorPlugin/voxelGenerator.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm75.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm80.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm75.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm80.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm86.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm75.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm75.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm86.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm75.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm80.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm75.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm80.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm86.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm80.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm86.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm80.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm80.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm75.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm80.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm86.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm75.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm86.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_il_int8_128_32_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm75.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm72.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm75.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm80.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm86.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm72.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm75.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm80.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm86.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm75.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm80.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm72.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm75.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm80.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm86.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm72.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm80.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm75.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm86.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm75.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm75.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm80.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm80.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextInt8InterleavedPlugin.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/fcPlugin/fcPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/checkMacrosPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernel.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/nmsHelper.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/reducedMathPlugin.cpp.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSInference.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/coordConvACPlugin/coordConvACPlugin.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/efficientNMSPlugin/efficientNMSInference.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/groupNormalizationPlugin/groupNormalizationKernel.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormFwdImpl.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterLayer.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/split.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o
/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(107): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(109): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(111): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(113): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here

[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?

[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBbox3DKernels.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o
/tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const T_BBOX *, const T_BBOX *, T_BBOX *, __nv_bool) [with T_BBOX=float, nthds_per_cta=512U]"
(309): here
instantiation of "pluginStatus_t decodeBBoxes_gpu<T_BBOX>(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const void *, const void *, void *, __nv_bool) [with T_BBOX=float]"
(350): here

/tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const T_BBOX *, const T_BBOX *, T_BBOX *, __nv_bool) [with T_BBOX=__half, nthds_per_cta=512U]"
(309): here
instantiation of "pluginStatus_t decodeBBoxes_gpu<T_BBOX>(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const void *, const void *, void *, __nv_bool) [with T_BBOX=__half]"
(351): here

[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here

[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/lReLU.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/pillarScatterKernels.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/voxelGeneratorKernels.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContext.cu.o
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/zeroPadding2d.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormKernel.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelHFace.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelMTron.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluKernel.cu.o
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?

[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelHFace.cu.o
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelMTron.cu.o
[100%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormKernel.cu.o
[100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/InferPlugin.cpp.o
[100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/__/samples/common/logger.cpp.o
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[100%] Linking CXX static library ../libnvinfer_plugin_static.a
[100%] Built target nvinfer_plugin_static
ros@Helge:/tmp/TensorRT/build$ ARCH=x86_64
ros@Helge:/tmp/TensorRT/build$ cp libnvinfer_plugin.so.8.2.* /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3
cp: cannot create regular file '/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so.8.2.3': Permission denied
ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin.so.8.2.* /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3
ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin_static.a /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin_static.a
ros@Helge:/tmp/TensorRT/build$ tao-converter -k engine1 -e /workspaces/vscode_foxy_ros2_cuda_2/trt.fp16.engine -p points,1x204800x4,1x204800x4,1x204800x4 -p num_points,1,1,1 -t fp16 /workspaces/vscode_foxy_ros2_cuda_2/pointpillars_deployable.etlt
bash: tao-converter: command not found`

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions