FSDP2 tutorial #4429

Job	Run time
pytorch_tutorial_build_worker (1, 15, linux.g5.12xlarge.nvidia.gpu)	15m 54s
pytorch_tutorial_build_worker (2, 15, linux.g5.4xlarge.nvidia.gpu)	41m 0s
pytorch_tutorial_build_worker (3, 15, linux.g5.4xlarge.nvidia.gpu)	23m 5s
pytorch_tutorial_build_worker (4, 15, linux.g5.4xlarge.nvidia.gpu)	39m 7s
pytorch_tutorial_build_worker (5, 15, linux.g5.4xlarge.nvidia.gpu)	23m 46s
pytorch_tutorial_build_worker (6, 15, linux.g5.4xlarge.nvidia.gpu)	23m 20s
pytorch_tutorial_build_worker (7, 15, linux.g5.4xlarge.nvidia.gpu)	20m 35s
pytorch_tutorial_build_worker (8, 15, linux.g5.4xlarge.nvidia.gpu)	21m 15s
pytorch_tutorial_build_worker (9, 15, linux.g5.4xlarge.nvidia.gpu)	18m 33s
pytorch_tutorial_build_worker (10, 15, linux.g5.4xlarge.nvidia.gpu)	17m 52s
pytorch_tutorial_build_worker (11, 15, linux.g5.4xlarge.nvidia.gpu)	16m 27s
pytorch_tutorial_build_worker (12, 15, linux.g5.4xlarge.nvidia.gpu)	21m 33s
pytorch_tutorial_build_worker (13, 15, linux.g5.4xlarge.nvidia.gpu)	28m 41s
pytorch_tutorial_build_worker (14, 15, linux.g5.4xlarge.nvidia.gpu)	27m 46s
pytorch_tutorial_build_worker (15, 15, linux.g5.4xlarge.nvidia.gpu)	32m 23s
pytorch_tutorial_build_manager	3m 52s
	6h 15m 9s

Provide feedback