[2/N] Core trainer abstraction#158

Ritesh1905 wants to merge 2 commits intomainmeta-pytorch/torchforge:mainfrom

rithesh/rfc_split_2meta-pytorch/torchforge:rithesh/rfc_split_2Copy head branch name to clipboard