-
Notifications
You must be signed in to change notification settings - Fork 14
Description
Hi,
i am getting this error after installing TensorRT OSS 22.02.
What am I doing wrong?
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
`nvidia-smi
Thu Nov 23 08:56:52 2023
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 2050 On | 00000000:01:00.0 Off | N/A |
| N/A 48C P5 3W / 20W | 1224MiB / 4096MiB | 16% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
+---------------------------------------------------------------------------------------+`
NAME="Ubuntu"
VERSION="20.04.6 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.6 LTS"
VERSION_ID="20.04"
`in_static.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/specialSlicePlugin/specialSlicePlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/splitPlugin.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/voxelGeneratorPlugin/voxelGenerator.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm75.cpp.o
[ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm80.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm75.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm80.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm86.cpp.o
[ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm80.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm75.cpp.o
[ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm75.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm75.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm80.cpp.o
[ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm86.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm75.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm80.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm75.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm80.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm86.cpp.o
[ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm80.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm86.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm80.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm75.cpp.o
[ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm80.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm75.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm80.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm86.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm75.cpp.o
[ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm86.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_il_int8_128_32_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm75.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm80.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm72.cpp.o
[ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm75.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm80.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm86.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm72.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm75.cpp.o
[ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm80.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm86.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm75.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm80.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm72.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm75.cpp.o
[ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm80.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm86.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm72.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm80.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm75.cpp.o
[ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm86.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm75.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm75.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm80.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm80.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextInt8InterleavedPlugin.cpp.o
[ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/fcPlugin/fcPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluPlugin.cpp.o
[ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/checkMacrosPlugin.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernel.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/nmsHelper.cpp.o
[ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/reducedMathPlugin.cpp.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSInference.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/coordConvACPlugin/coordConvACPlugin.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/efficientNMSPlugin/efficientNMSInference.cu.o
[ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/groupNormalizationPlugin/groupNormalizationKernel.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormFwdImpl.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterLayer.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/split.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o
[ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o
/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(107): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here
/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(109): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here
/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(111): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here
/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(113): warning #1444-D: function "saturate(float)"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_BBOX *, T_BBOX *, __nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(151): here
instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, void *, void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]"
(200): here
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBbox3DKernels.cu.o
[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o
/tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const T_BBOX *, const T_BBOX *, T_BBOX *, __nv_bool) [with T_BBOX=float, nthds_per_cta=512U]"
(309): here
instantiation of "pluginStatus_t decodeBBoxes_gpu<T_BBOX>(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const void *, const void *, void *, __nv_bool) [with T_BBOX=float]"
(350): here
/tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const T_BBOX *, const T_BBOX *, T_BBOX *, __nv_bool) [with T_BBOX=__half, nthds_per_cta=512U]"
(309): here
instantiation of "pluginStatus_t decodeBBoxes_gpu<T_BBOX>(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, __nv_bool, int, int, __nv_bool, const void *, const void *, void *, __nv_bool) [with T_BBOX=__half]"
(351): here
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=float, T_SCORE=float]"
(177): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here
/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate"
/usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).")
detected during:
instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(__nv_bool, int, int, int, int, int, const int *, const T_SCORE *, const T_BBOX *, int *, T_BBOX *, T_SCORE) [with T_BBOX=__half, T_SCORE=__half, nthds_per_cta=32U]"
(131): here
instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, __nv_bool, int, int, int, int, int, const void *, const void *, const void *, void *, void *, float) [with T_BBOX=__half, T_SCORE=__half]"
(178): here
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/lReLU.cu.o
[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/pillarScatterKernels.cu.o
[ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o
[ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/voxelGeneratorKernels.cu.o
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContext.cu.o
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?
[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/zeroPadding2d.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormKernel.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelHFace.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelMTron.cu.o
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluKernel.cu.o
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelHFace.cu.o
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?
[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelMTron.cu.o
[100%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormKernel.cu.o
[100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/InferPlugin.cpp.o
[100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/__/samples/common/logger.cpp.o
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?
/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?
[100%] Linking CXX static library ../libnvinfer_plugin_static.a
[100%] Built target nvinfer_plugin_static
ros@Helge:/tmp/TensorRT/build$ ARCH=x86_64
ros@Helge:/tmp/TensorRT/build$ cp libnvinfer_plugin.so.8.2.* /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3
cp: cannot create regular file '/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so.8.2.3': Permission denied
ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin.so.8.2.* /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3
ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin_static.a /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin_static.a
ros@Helge:/tmp/TensorRT/build$ tao-converter -k engine1 -e /workspaces/vscode_foxy_ros2_cuda_2/trt.fp16.engine -p points,1x204800x4,1x204800x4,1x204800x4 -p num_points,1,1,1 -t fp16 /workspaces/vscode_foxy_ros2_cuda_2/pointpillars_deployable.etlt
bash: tao-converter: command not found`