SmallGPT

A minimal GPT implementation from scratch for learning purposes.

Quick Start

Install dependencies:

$ pip install -r requirements.txt

Train the tokenizer:

python tokenizer.py train

Train the model:

python smallgpt.py train

Supervised Fine-tuning:

python tuning.py