Skip to content

Commit 1723cd3

Browse files
guillepintoFactral
andauthored
Add transformer architecture (#26)
* first implementation development and explanation * detailed explanations added * torchinfo version added * add math --------- Co-authored-by: Fabian Perez *-* <nelsonfabiancs8@gmail.com>
1 parent cb75559 commit 1723cd3

File tree

2 files changed

+712
-1
lines changed

2 files changed

+712
-1
lines changed

automation/notebooks-table-data.csv

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,4 +14,5 @@ GloVe Word Embeddings, data_exploration/glove-word-embeddings.ipynb,https://gith
1414
Vision Transformer (ViT),architectures/vit.ipynb,,https://arxiv.org/pdf/2010.11929
1515
Multi-Head Attention, modules/multihead-self-attention.ipynb,,https://arxiv.org/abs/1706.03762
1616
ResNet,architectures/resnet.ipynb,,https://arxiv.org/abs/1512.03385
17-
Convolutional Block Attention, modules/convolutional-block-attention.ipynb,,https://arxiv.org/abs/1807.06521
17+
Convolutional Block Attention, modules/convolutional-block-attention.ipynb,,https://arxiv.org/abs/1807.06521
18+
Transformer, architectures/transformer.ipynb,,https://arxiv.org/abs/1706.03762

0 commit comments

Comments
 (0)