Skip to content

i am trying to make a transformer model after reading the "Attention is all you need paper" - recommended

Notifications You must be signed in to change notification settings

smundhra-git/char-transformers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

N-Dimensional Transformer from Scratch in C++

If you are here purely to learn, after reading the Readme, you should definetely read document.txt - it talks about hows, whats and whys which is crucial and contains links to some amazing papers, articles and youtube videos I will definietely recommend.

A lightweight, dependency-free implementation of a Transformer model (based on "Attention Is All You Need") written entirely in C++.

I have not used any external libraries like Eigen or BLAS to write this (though using them may have made this project quicker). Getting on how to run it simple -

Ensure you have cmake and a C++17 compatible compiler, then run this commands

cmake .
make
./main

Feel free to contribute and optimize this as much as possible.

About

i am trying to make a transformer model after reading the "Attention is all you need paper" - recommended

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published