Skip to content

Commit 671cdb0

Browse files
committed
Automated tutorials push
1 parent 0c2da3c commit 671cdb0

File tree

197 files changed

+13000
-13584
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

197 files changed

+13000
-13584
lines changed

_downloads/57114670a041b4c96ed6eb9fc17a6b3f/transformer_building_blocks.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,6 @@
33
=============================================================================================================
44
**Author:** `Mikayla Gawarecki <https://github.com/mikaylagawarecki>`_
55
6-
.. note::
7-
This tutorial currently requires you to use the PyTorch nightly build.
86
97
.. grid:: 2
108

_downloads/e201125c39959609ca168c306995205c/transformer_building_blocks.ipynb

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -22,14 +22,6 @@
2222
"\n",
2323
"**Author:** [Mikayla Gawarecki](https://github.com/mikaylagawarecki)\n",
2424
"\n",
25-
"<div style=\"background-color: #54c7ec; color: #fff; font-weight: 700; padding-left: 10px; padding-top: 5px; padding-bottom: 5px\"><strong>NOTE:</strong></div>\n",
26-
"\n",
27-
"<div style=\"background-color: #f3f4f7; padding-left: 10px; padding-top: 10px; padding-bottom: 10px; padding-right: 10px\">\n",
28-
"\n",
29-
"<p>This tutorial currently requires you to use the PyTorch nightly build.</p>\n",
30-
"\n",
31-
"</div>\n",
32-
"\n",
3325
"<div style=\"width: 45%; float: left; padding: 20px;\"><h2> What you will learn</h2><ul><li>Learn about the low-level building blocks PyTorch provides to build custom transformer layers (nested tensors, <code>scaled_dot_product_attention</code>, <code>torch.compile()</code>, and <code>FlexAttention</code>)</li><li>Discover how the above improve memory usage and performance using MultiHeadAttention as an example</li><li>Explore advanced customizations using the aforementioned building blocks</li></ul></div><div style=\"width: 45%; float: right; padding: 20px;\"><h2> Prerequisites</h2><ul><li>PyTorch v.2.6.0 or later</li></ul></div>\n",
3426
"\n",
3527
"Over the past few years, the PyTorch team has developed various lower\n",
-27 Bytes
Loading
-94 Bytes
Loading

_images/sphx_glr_coding_ddpg_001.png

-6.54 KB
Loading
4.27 KB
Loading
17 Bytes
Loading
193 Bytes
Loading
-61 Bytes
Loading
-893 Bytes
Loading

0 commit comments

Comments
 (0)