fix: Allow for multi node training for accelerated moe#129

fabianlim merged 1 commit intofoundation-model-stack:mainfoundation-model-stack/fms-acceleration:mainfrom

kmehant:mn-sharedmoe-finalkmehant/fms-acceleration:mn-sharedmoe-finalCopy head branch name to clipboard