Merge branch 'main' into triton_kernel

Author: kookyungseon

beginner_source/dist_overview.rst

@@ -70,7 +70,7 @@ When deciding what parallelism techniques to choose for your model, use these co
 #. Use `DistributedDataParallel (DDP) <https://pytorch.org/docs/stable/notes/ddp.html>`__,
    if your model fits in a single GPU but you want to easily scale up training using multiple GPUs.
 
-   * Use `torchrun <https://pytorch.org/docs/stable/elastic/run.html>`__, to launch multiple pytorch processes if you are you using more than one node.
+   * Use `torchrun <https://pytorch.org/docs/stable/elastic/run.html>`__, to launch multiple pytorch processes if you are using more than one node.
 
    * See also: `Getting Started with Distributed Data Parallel <../intermediate/ddp_tutorial.html>`__
 

intermediate_source/dist_tuto.rst

@@ -569,7 +569,7 @@ finally handshake with them.
 -  ``WORLD_SIZE``: The total number of processes, so that the master
    knows how many workers to wait for.
 -  ``RANK``: Rank of each process, so they will know whether it is the
-   master of a worker.
+   master or a worker.
 
 **Shared File System**