#

masked-attention

Here are 5 public repositories matching this topic...

shaheennabi / Decoder-Only-Transformer-Architecture-Implementation-in-Pytorch

A complete implementation of a Decoder-Only Transformer (GPT-style) built using PyTorch, without relying on high-level abstractions. This implementation includes all core components: token embeddings, positional embeddings, multi-head self-attention, feedforward networks, causal masking, and output logits generation.

attention-is-all-you-need positional-encoding masked-attention decoder-only-transformer

Updated Feb 18, 2026
Python

msmrexe / pytorch-transformer-from-scratch

A complete implementation of the "Attention Is All You Need" Transformer model from scratch using PyTorch. This project focuses on building and training a Transformer for neural machine translation (English-to-Italian) on the OpusBooks dataset.

machine-learning university-project pytorch transformer course-project seq2seq attention neural-machine-translation attention-mechanism encoder-decoder attention-is-all-you-need huggingface positional-encoding transformer-from-scratch cross-attention masked-attention

Updated Nov 8, 2025
Python

MAGICS-LAB / state_space_duality

On Structured State-Space Duality

state-space transformer attention-mechanism mamba state-space-model masked-attention structured-state-space-models

Updated Jan 27, 2026
Python

kennethsible / dictionary-attention

Improving Rare Word Translation with Dictionaries and Attention Masking

machine-translation bilingual-dictionary masked-attention

Updated Mar 25, 2025
Python

Djasingh / Tranformer_Model

Neural Network, Backpropagation, and Transformer Decoder

neural-networks derivatives gardient-descent masked-attention positional-encoding- transformer-decoder-model

Updated Mar 19, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the masked-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the masked-attention topic, visit your repo's landing page and select "manage topics."