Use all gpus available for training#293

Abecid wants to merge 1 commit intoLightning-AI:mainLightning-AI/lit-llama:mainfrom

AttentionX:multi_gpusAttentionX/lit-llama:multi_gpusCopy head branch name to clipboard