@@ -10,7 +10,7 @@ def _unroll_allgather_recv(recv_buf, chunk_shape, send_buf_shapes, displs=None)
1010
1111 Depending on the provided parameters, the function:
1212 - uses ``displs`` and element counts to extract variable-sized chunks.
13- - removes padding and reshapes each chunk using ``padded_send_buf_shape ``.
13+ - removes padding and reshapes each chunk using ``chunk_shape ``.
1414
1515 Each rank may send an array with a different shape, so the return type is a list of arrays
1616 instead of a concatenated array.
@@ -20,11 +20,12 @@ def _unroll_allgather_recv(recv_buf, chunk_shape, send_buf_shapes, displs=None)
2020 recv_buf: :obj:`cupy.ndarray` or array-like
2121 The data buffer returned from nccl_allgather call
2222 send_buf_shapes: :obj:`list`
23- A list ofOriginal shapes of each rank's send_buf before any padding.
23+ A list of original shapes of each rank's send_buf before any padding.
2424 chunk_shape : tuple
2525 Shape of each gathered chunk in recv_buf. This must match the shape
2626 used to construct the gathered buffer: use the padded send buffer shape
27- when padding is required, or the original send buffer shape when no padding is used.
27+ when padding is required (e.g., nccl_allgather with padding), or the original send buffer
28+ shape when no padding is used.
2829 displs : list, optional
2930 Starting offsets in recv_buf for each rank's data, used when chunks have
3031 variable sizes (e.g., mpi_allgather with displacements).
0 commit comments