-
Couldn't load subscription status.
- Fork 5
Open
Labels
enhancementNew feature or requestNew feature or request
Description
So far the mpi_allgather method uses the _prepare_allgather_inputs method to prepare inputs such that they are all of the same size (via zero-padding). Whilst this is strictly needed for NCCL, we should instead consider leveraging MPI `AllGatherv' instead to avoid extra padding and cutting of arrays.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request