Merge branch 'main' into add-new-theme

Author: svekars

intermediate_source/transformer_building_blocks.py

@@ -1,4 +1,7 @@
 """
+.. meta::
+  :description: Learn how to optimize transformer models by replacing nn.Transformer with Nested Tensors and torch.compile() for significant performance gains in PyTorch.
+
 Accelerating PyTorch Transformers by replacing ``nn.Transformer`` with Nested Tensors and ``torch.compile()``
 =============================================================================================================
 **Author:** `Mikayla Gawarecki <https://github.com/mikaylagawarecki>`_

prototype_source/nestedtensor.py

@@ -369,3 +369,8 @@ def benchmark(func, *args, **kwargs):
 # how implement multi-head attention for transformers in a way that avoids computation on padding.
 # For more information, check out the docs for the
 # `torch.nested <https://pytorch.org/docs/stable/nested.html>`__ namespace.
+#
+# See Also
+# --------
+#
+# * `Accelerating PyTorch Transformers by replacing nn.Transformer with Nested Tensors and torch.compile() <https://docs.pytorch.org/tutorials/intermediate/transformer_building_blocks.html`__

prototype_source/prototype_index.rst

@@ -271,7 +271,7 @@ Prototype features are not available as part of binary distributions like PyPI o
    :header: (prototype) Using GPUDirect Storage
    :card_description: Learn how to use GPUDirect Storage in PyTorch.
    :image: ../_static/img/thumbnails/cropped/generic-pytorch-logo.png
-   :link: ../prototype/gpudirect_storage.html
+   :link: ../prototype/gpu_direct_storage.html
    :tags: GPUDirect-Storage
 
 .. End of tutorial card section