ERR_NVGPUCTRPERM: Permission issue with NVIDIA GPU Performance Counters

[tonyyxliu]

First raised by Haoyi Yu.

Should be fixed according to: https://developer.nvidia.com/nvidia-development-tools-solutions-err_nvgpuctrperm-permission-issue-performance-counters

[tonyyxliu]

Issue has been fixed. Now students can access NVIDIA GPU performance counters on all nodes in Release partition. Nodes in Debug partition still cannot access these performance counters.

Attached with the screenshot of a succeeded profile

srun -n 1 --gpus 1 ncu -o ../profile/cuda_PartA --set full --target-processes all ./src/gpu/cuda_PartA ../images/4K
-RGB.jpg ../images/4K-Gray.jpg
==PROF== Connected to process 2213 (/nfsmnt/118010200/CUHKSZ-CSC4005/project1/build/src/gpu/cuda_PartA)
==PROF== Profiling "rgbToGray" - 0: 0%....50%....100% - 31 passes
Input file from: ../images/4K-RGB.jpg
Output file to: ../images/4K-Gray.jpg
Transformation Complete!
GPU Execution Time: 949.473 milliseconds
==PROF== Disconnected from process 2213
==PROF== Report: /nfsmnt/118010200/CUHKSZ-CSC4005/project1/build/../profile/cuda_PartA.ncu-rep