Support of multi-node training

[zheng95z]

Hi team, great project!

I'm wondering if this library support multi-node training with accelerate. Say 4 nodes of 8 GPUs.

[yihao-meng]

same question