Use better shape count for NVIDIA megatron training.#1855

matz-e merged 1 commit intomainoracle-devrel/technology-engineering:mainfrom

update-nvidia-megatronoracle-devrel/technology-engineering:update-nvidia-megatronCopy head branch name to clipboard