A tutorial on pin_memory and non_blocking usage #2606

Job	Run time
pytorch_tutorial_build_worker (1, 15, linux.g5.12xlarge.nvidia.gpu)	13m 25s
pytorch_tutorial_build_worker (2, 15, linux.g5.4xlarge.nvidia.gpu)	49m 43s
pytorch_tutorial_build_worker (3, 15, linux.g5.4xlarge.nvidia.gpu)	17m 19s
pytorch_tutorial_build_worker (4, 15, linux.g5.4xlarge.nvidia.gpu)	26m 25s
pytorch_tutorial_build_worker (5, 15, linux.g5.4xlarge.nvidia.gpu)	17m 44s
pytorch_tutorial_build_worker (6, 15, linux.g5.4xlarge.nvidia.gpu)	14m 58s
pytorch_tutorial_build_worker (7, 15, linux.4xlarge.nvidia.gpu)	18m 59s
pytorch_tutorial_build_worker (8, 15, linux.4xlarge.nvidia.gpu)	17m 40s
pytorch_tutorial_build_worker (9, 15, linux.4xlarge.nvidia.gpu)	35m 31s
pytorch_tutorial_build_worker (10, 15, linux.4xlarge.nvidia.gpu)	45m 20s
pytorch_tutorial_build_worker (11, 15, linux.4xlarge.nvidia.gpu)	29m 32s
pytorch_tutorial_build_worker (12, 15, linux.4xlarge.nvidia.gpu)	16m 49s
pytorch_tutorial_build_worker (13, 15, linux.4xlarge.nvidia.gpu)	18m 58s
pytorch_tutorial_build_worker (14, 15, linux.4xlarge.nvidia.gpu)	12m 47s
pytorch_tutorial_build_worker (15, 15, linux.4xlarge.nvidia.gpu)	19m 35s
pytorch_tutorial_build_manager	20m 35s
	6h 15m 20s

Provide feedback