We strongly recommend to start with AzureML recipe in the azureml folder.
If you have a custom infrastructure (e.g. HPC clusters) or Azure VM and VMSS based environments, please refer to the bash scripts in the azure folder.
Please see the MoE folder for different training recipes and scripts for Mixture-of-expert based models.
Curriculum learning recipes are in the curriculum_learning folder. Please refer to the detailed tutorials linked inside.