📒 Kaggle Notebooks

📒 Fine-tuning Notebooks

Below are Colab notebooks, organized by model. You can also view all notebooks in our docs.
The notebooks run locally and feature data prep, training and inference. Read our fine-tuning guide.

Main Notebooks

Model	Type	Notebook Link
Unsloth Studio	Chat UI
Gemma 4 (E2B)	Vision
Qwen3.5 (4B)	Vision
Qwen3.5 (2B)	Vision
gpt-oss (20B)	Fine-tuning
gpt-oss (20B)	GRPO
Qwen3 (14B)	Conversational
Qwen3-VL (8B)	Vision
Qwen3-Embedding (0.6B)	Embeddings
Qwen3: Advanced GRPO	GRPO
Gemma 3 (4B)	Vision
Gemma 3N (4B)	Audio
embeddinggemma (300M)	Embeddings
Mistral Ministral 3 (3B)	Vision
Mistral v0.3 (7B)	Vision
Llama 3.1 (8B) Alpaca	Alpaca
Llama 3.2 (1B + 3B)	Conversational
Phi-4 (14B)	Conversational
Orpheus-TTS (3B)	TTS

GRPO & Reinforcement Learning Notebooks

Model	Type	Notebook Link
Llama3.1 (8B)	GSM8K Math + vLLM
NeMo Gym Sudoku	Sudoku
NeMo Gym Multi Environment	Multi Environment
gpt oss BF16 (20B)	2048 Game
gpt oss (20B)	Minesweeper Game
gpt oss (20B)	Auto Kernel Creation
Qwen3 (8B)	DAPO Math + vLLM
Llama3 (8B)	ORPO
Openenv wordle	Wordle + vLLM
Qwen2.5 VL (7B)	Vision Math + vLLM
Zephyr (7B)	DPO
(OpenEnv) gpt oss BF16 (20B)	2048 Game
gpt oss (20B)	Auto Kernel Creation
gpt oss (20B)	2048 Game
(OpenEnv) gpt oss (20B)	2048 Game
(DGX Spark) gpt oss (20B)	2048 Game
(A100) gpt oss (20B)	Auto Kernel Creation
Qwen2.5 (3B)	GSM8K Math + vLLM
Llama3.2 (1B)	DAPO Math + vLLM
Qwen3 VL (8B)	Vision Math
Mistral v0.3 (7B)	GSM8K Math + vLLM
Qwen3 5 (4B)	Vision Math
Gemma3 (4B)	Vision Math
Phi 4 (14B)	GSM8K Math + vLLM
Gemma3 (1B)	GSM8K Math
DeepSeek R1 0528 Qwen3 (8B)	DAPO Math + vLLM
LFM2.5 (1.2B)	DAPO Math
Qwen3 (4B)	DAPO Math + vLLM
Ministral3 (3B)	Sudoku

Tool Calling Notebooks

Model	Type	Notebook Link
Qwen2.5 Coder (1.5B)	Tool Calling
FunctionGemma (270M)	Tool Calling
FunctionGemma (270M)	Mobile Actions
FunctionGemma (270M)	Inference
FunctionGemma (270M)	Conversational

Text-to-Speech (TTS) Notebooks

Model	Type	Notebook Link
Spark TTS (0.5B)	TTS
Orpheus (3B)	TTS
Llasa TTS (3B)	TTS
Llasa TTS (1B)	TTS
Sesame CSM (1B)	TTS
Oute TTS (1B)	TTS

Vision (Multimodal) Notebooks

Model	Type	Notebook Link
Qwen2.5 VL (7B)	Vision Math + vLLM (GRPO RL)
Gemma4 (E4B)	Vision
Gemma4 (E2B)	Vision
Gemma4 (26B A4B)	Vision
Gemma4 (31B)	Vision
Qwen2.5 VL (7B)	Vision
ERNIE 4 5 VL 28B A3B PT	Vision
Qwen3 VL (8B)	Vision
Qwen3 VL (8B)	Vision Math (GRPO RL)
Qwen3 5 (4B)	Vision
Qwen3 5 (4B)	Vision Math (GRPO RL)
Gemma3 (4B)	Vision Math (GRPO RL)
Qwen3 5 (0 8B)	Vision
Qwen2 VL (7B)	Vision
Llama3.2 (11B)	Vision
Qwen3 5 (2B)	Vision
Pixtral (12B)	Vision
LFM2.5 VL (1.6B)	Vision
Ministral3 VL (3B)	Vision
Gemma3 (4B)	Vision
Gemma3N (4B)	Vision

Embedding Notebooks

Model	Type	Notebook Link
ModernBert
Qwen3 Embedding (4B)
Qwen3 Embedding (0 6B)
EmbeddingGemma (300M)
BGE M3
ModernBERT (Large)	Classification
All MiniLM L6 v2

Speech-to-Text (STT) Notebooks

Model	Type	Notebook Link
Whisper (Large)	Fine Tuning

OCR Notebooks

Model	Type	Notebook Link
Deepseek OCR (3B)	Fine Tuning
Deepseek OCR (3B)	Evaluation
Deepseek OCR (3B)	Eval
Deepseek OCR 2 (3B)
Paddle OCR (1B)	Vision

BERT Notebooks

Model	Type	Notebook Link
ModernBert
ModernBERT (Large)	Classification

Deepseek Notebooks

Model	Type	Notebook Link
Deepseek OCR (3B)	Fine Tuning
Deepseek OCR (3B)	Evaluation
Deepseek OCR (3B)	Eval
Deepseek OCR 2 (3B)

ERNIE Notebooks

Model	Type	Notebook Link
ERNIE 4 5 VL 28B A3B PT	Vision
ERNIE 4 5 21B A3B PT	Conversational

GLM Notebooks

Model	Type	Notebook Link
(A100) GLM Flash(80GB)

GPT-OSS Notebooks

Model	Type	Notebook Link
gpt oss MXFP4 (20B)	Inference
gpt oss (20B)	Fine Tuning
gpt oss (20B)	Fine Tuning
gpt oss BNB (20B)	Inference
(A100) gpt oss (120B)	Fine Tuning

Gemma 4 Notebooks

Model	Type	Notebook Link
Gemma4 (E4B)	Vision
Gemma4 (E4B)	Conversational
Gemma4 (E4B)	Audio
Gemma4 (E2B)	Vision
Gemma4 (E2B)	Audio
Gemma4 (E2B)	Conversational
Gemma4 (26B A4B)	Conversational
Gemma4 (26B A4B)	Vision
Gemma4 (31B)	Vision
Gemma4 (31B)	Conversational

Gemma Notebooks

Model	Type	Notebook Link
Gemma3 (4B)	Conversational
(A100) Gemma3 (27B)	Conversational
Gemma3 (270M)	Conversational
Gemma3 (270M)
Gemma3N (4B)	Multimodal
Gemma3N (4B)	Audio
Gemma3N (2B)	Inference
Gemma3 (4B)	Vision
Gemma3N (4B)	Vision
EmbeddingGemma (300M)
Gemma2 (9B)	Alpaca
Gemma2 (2B)	Alpaca
CodeGemma (7B)	Conversational

Granite Notebooks

Model	Type	Notebook Link
Granite4.0 (3B)	Conversational
Granite4.0 (350M)	Conversational

Hybrid Attention Notebooks

Model	Type	Notebook Link
LFM2.5 (1.2B)	Conversational
LFM2.5 VL (1.6B)	Vision
Liquid LFM2 (1.2B)	Conversational
Liquid LFM2	Conversational
LFM2.5 (1.2B)
Falcon H1 (0.5B)	Alpaca
Falcon H1	Alpaca

Llama Notebooks

Model	Type	Notebook Link
Llama3.1 (8B)	Inference
Llama3 (8B)	Ollama
Llama3 (8B)	Alpaca
Llama3.2 (1B and 3B)	Conversational
Llama3.2 (1B)	RAFT
Llama3.1 (8B)	Alpaca
(A100) Llama3.3 (70B)	Conversational
Llama3.2 (11B)	Vision
Llama3 (8B)	Conversational
TinyLlama (1.1B)	Alpaca

Mistral Notebooks

Model	Type	Notebook Link
Mistral v0.3 (7B)	Conversational
Magistral (24B)	Reasoning Conversational
Pixtral (12B)	Vision
Mistral Small (22B)	Alpaca
Ministral3 VL (3B)	Vision
Mistral v0.3 (7B)	Alpaca
Mistral Nemo (12B)	Alpaca

Nemotron Notebooks

Model	Type	Notebook Link
(A100) Nemotron Nano 3 30B A3B
(A100) Nemotron 3 Nano 30B A3B

Paddle Notebooks

Model	Type	Notebook Link
Paddle OCR (1B)	Vision

Phi Notebooks

Model	Type	Notebook Link
Phi 4	Conversational
Phi 3.5 Mini	Conversational
Phi 3 Medium	Conversational

Qwen Notebooks

Model	Type	Notebook Link
Qwen3 (0.6B)	Reasoning Conversational
Qwen3 (0 6B)
Qwen3 (4B)	QAT
Qwen3 (4B)	Conversational
Qwen2.5 VL (7B)	Vision
Qwen3 VL (8B)	Vision
Qwen3 5 MoE
(A100) Qwen 3 5 27B(80GB)
(A100) Qwen3 (32B)	Reasoning Conversational
Qwen3 5 (4B)	Vision
Qwen3 (14B)	Reasoning Conversational
Qwen3 (14B)
Qwen3 5 (0 8B)	Vision
Qwen2 VL (7B)	Vision
Qwen3 (4B)	Thinking
Qwen3 MoE
Qwen3 5 (2B)	Vision
Qwen2.5 (7B)	Alpaca
Qwen2.5 Coder (14B)	Conversational
Qwen3 Embedding (4B)
Qwen3 Embedding (0 6B)
Qwen3 (14B)	Alpaca
Qwen2 (7B)	Alpaca
TinyQwen3 MoE

Text Completion / Continued Pretraining Notebooks

Model	Type	Notebook Link
LFM2.5 (1.2B)	Text Completion
Mistral v0.3 (7B)	CPT
Mistral (7B)	Text Completion

Specific use-case Notebooks

Usecase	Model	Notebook Link
Text Classification	Llama 3.1 (8B)
Tool Calling	Qwen2.5-Coder (1.5B)
Multiple Datasets
KTO	Qwen2.5-Instruct (1.5B)
Inference Chat UI	LLaMa 3.2 Vision
Conversational	LLaMa 3.2 (1B and 3B)
ChatML	Mistral (7B)
Text Completion	Mistral (7B)

Other Notebooks

Model	Type	Notebook Link
CodeForces cot Finetune for Reasoning on CodeForces	Reasoning
Synthetic Data Hackathon	Synthetic Data
Unsloth	Studio

📒 Kaggle Notebooks

Click for all our Kaggle notebooks categorized by model:

GRPO & Reinforcement Learning Notebooks

Model	Type	Notebook Link
Llama3.1 (8B)	GSM8K Math + vLLM
gpt oss (20B)	Minesweeper Game
gpt oss (20B)	Auto Kernel Creation
Qwen3 (8B)	DAPO Math + vLLM
Llama3 (8B)	ORPO
Qwen2.5 VL (7B)	Vision Math + vLLM
Ministral3 (3B)	Sudoku
Zephyr (7B)	DPO
gpt oss (20B)	Auto Kernel Creation
(A100) gpt oss (20B)	Auto Kernel Creation
Qwen2.5 (3B)	GSM8K Math + vLLM
Llama3.2 (1B)	DAPO Math + vLLM
Qwen3 VL (8B)	Vision Math
Mistral v0.3 (7B)	GSM8K Math + vLLM
Gemma3 (4B)	Vision Math
Phi 4 (14B)	GSM8K Math + vLLM
Gemma3 (1B)	GSM8K Math
DeepSeek R1 0528 Qwen3 (8B)	DAPO Math + vLLM
Qwen3 (4B)	DAPO Math + vLLM

Tool Calling Notebooks

Model	Type	Notebook Link
Qwen2.5 Coder (1.5B)	Tool Calling

Text-to-Speech (TTS) Notebooks

Model	Type	Notebook Link
Spark TTS (0.5B)	TTS
Orpheus (3B)	TTS
Llasa TTS (3B)	TTS
Llasa TTS (1B)	TTS
Sesame CSM (1B)	TTS
Oute TTS (1B)	TTS

Vision (Multimodal) Notebooks

Model	Type	Notebook Link
Qwen2.5 VL (7B)	Vision Math + vLLM (GRPO RL)
Qwen2.5 VL (7B)	Vision
ERNIE 4 5 VL 28B A3B PT	Vision
Qwen3 VL (8B)	Vision
Qwen3 VL (8B)	Vision Math (GRPO RL)
Gemma3 (4B)	Vision Math (GRPO RL)
Qwen2 VL (7B)	Vision
Llama3.2 (11B)	Vision
Pixtral (12B)	Vision
Ministral3 VL (3B)	Vision
Gemma3 (4B)	Vision
Gemma3N (4B)	Vision

Embedding Notebooks

Model	Type	Notebook Link
ModernBert
Qwen3 Embedding (4B)
Qwen3 Embedding (0 6B)
EmbeddingGemma (300M)
BGE M3
ModernBERT (Large)	Classification
All MiniLM L6 v2

Speech-to-Text (STT) Notebooks

Model	Type	Notebook Link
Whisper (Large)	Fine Tuning

OCR Notebooks

Model	Type	Notebook Link
Deepseek OCR (3B)	Fine Tuning
Deepseek OCR (3B)	Evaluation
Deepseek OCR (3B)	Eval
Deepseek OCR 2 (3B)
Paddle OCR (1B)	Vision

BERT Notebooks

Model	Type	Notebook Link
ModernBert
ModernBERT (Large)	Classification

Deepseek Notebooks

Model	Type	Notebook Link
Deepseek OCR (3B)	Fine Tuning
Deepseek OCR (3B)	Evaluation
Deepseek OCR (3B)	Eval
Deepseek OCR 2 (3B)

ERNIE Notebooks

Model	Type	Notebook Link
ERNIE 4 5 VL 28B A3B PT	Vision
ERNIE 4 5 21B A3B PT	Conversational

GPT-OSS Notebooks

Model	Type	Notebook Link
gpt oss MXFP4 (20B)	Inference
gpt oss (20B)	Fine Tuning
gpt oss (20B)	Fine Tuning
gpt oss BNB (20B)	Inference
(A100) gpt oss (120B)	Fine Tuning

Gemma Notebooks

Model	Type	Notebook Link
Gemma3 (4B)	Conversational
(A100) Gemma3 (27B)	Conversational
Gemma3 (270M)	Conversational
Gemma3N (4B)	Multimodal
Gemma3N (4B)	Audio
Gemma3N (2B)	Inference
Gemma3 (4B)	Vision
Gemma3N (4B)	Vision
EmbeddingGemma (300M)
Gemma2 (9B)	Alpaca
Gemma2 (2B)	Alpaca
CodeGemma (7B)	Conversational

Granite Notebooks

Model	Type	Notebook Link
Granite4.0 (3B)	Conversational
Granite4.0 (350M)	Conversational

Hybrid Attention Notebooks

Model	Type	Notebook Link
Liquid LFM2 (1.2B)	Conversational
Falcon H1 (0.5B)	Alpaca

Llama Notebooks

Model	Type	Notebook Link
Llama3.1 (8B)	Inference
Llama3 (8B)	Ollama
Llama3 (8B)	Alpaca
Llama3.2 (1B and 3B)	Conversational
Llama3.2 (1B)	RAFT
Llama3.1 (8B)	Alpaca
(A100) Llama3.3 (70B)	Conversational
Llama3.2 (11B)	Vision
Llama3 (8B)	Conversational
TinyLlama (1.1B)	Alpaca

Mistral Notebooks

Model	Type	Notebook Link
Mistral v0.3 (7B)	Conversational
Magistral (24B)	Reasoning Conversational
Pixtral (12B)	Vision
Mistral Small (22B)	Alpaca
Ministral3 VL (3B)	Vision
Mistral v0.3 (7B)	Alpaca
Mistral Nemo (12B)	Alpaca

Nemotron Notebooks

Model	Type	Notebook Link
(A100) Nemotron Nano 3 30B A3B
(A100) Nemotron 3 Nano 30B A3B

Paddle Notebooks

Model	Type	Notebook Link
Paddle OCR (1B)	Vision

Phi Notebooks

Model	Type	Notebook Link
Phi 4	Conversational
Phi 3.5 Mini	Conversational
Phi 3 Medium	Conversational

Qwen Notebooks

Model	Type	Notebook Link
Qwen3 (4B)	QAT
Qwen3 (4B)	Conversational
Qwen2.5 VL (7B)	Vision
Qwen3 VL (8B)	Vision
(A100) Qwen3 (32B)	Reasoning Conversational
Qwen3 (14B)	Reasoning Conversational
Qwen3 (14B)
Qwen2 VL (7B)	Vision
Qwen3 (4B)	Thinking
Qwen2.5 (7B)	Alpaca
Qwen2.5 Coder (14B)	Conversational
Qwen3 Embedding (4B)
Qwen3 Embedding (0 6B)
Qwen3 (14B)	Alpaca
Qwen2 (7B)	Alpaca

Text Completion / Continued Pretraining Notebooks

Model	Type	Notebook Link
Mistral v0.3 (7B)	CPT
Mistral (7B)	Text Completion

Other Notebooks

Model	Type	Notebook Link
CodeForces cot Finetune for Reasoning on CodeForces	Reasoning
Unsloth	Studio

Known Issues / Environment Notes

NumPy 2.x ↔ soxr: NumPy 2.x breaks soxr, causing Unsloth import failures. Pin numpy<2 to resolve. Use pip install --force-reinstall "numpy<2" if needed. Impact: Prevents Unsloth from running.
soxr reinstall: pip install --force-reinstall soxr can pull NumPy 2.x back unless using --no-deps. Use pip install --force-reinstall --no-deps soxr to avoid this. Impact: May reintroduce NumPy 2.x and break Unsloth imports.
typing_extensions: Older typing_extensions can break torch import (TypeIs missing) until upgraded. Upgrade with pip install --upgrade typing_extensions. Impact: Prevents PyTorch from importing correctly.
Resolver warnings: Pinning numpy<2 can cause pip resolver warnings with SciPy/Numba; typically non-fatal. Impact: Cosmetic warnings only, does not affect functionality.
ROCm / triton_key: LoRA backward can crash under torch.compile if Triton lacks triton_key; workaround is to disable Inductor/compile on ROCm (handled in code now, but worth noting). Impact: May cause training crashes on AMD GPUs when using torch.compile.

✨ Contributing to Notebooks

If you'd like to contribute to our notebooks, here's a guide to get you started:

Find the Template: We've provided a template notebook called Template_Notebook.ipynb in the root directory of this project. This template contains the basic structure and formatting guidelines for all notebooks in this collection.
Create Your Notebook:
- Make a copy of Template_Notebook.ipynb.
- Rename the copied file to follow this naming convention:
  - LLM Notebooks: <Model Name>-<Type>.ipynb (e.g., Mistral_v0.3_(7B)-Alpaca.ipynb)
  - Vision Notebooks: <Model Name>-Vision.ipynb (e.g., Llava_v1.6_(7B)-Vision.ipynb)
  - Example of <Type>: Alpaca, Conversational, CPT, DPO, ORPO, Text_Completion, CSV, Inference, Unsloth_Studio
Place in original_template: Once your notebook is ready, move it to the original_template directory.
Update Notebooks: Run the following command in your terminal:
```
python update_all_notebooks.py
```
This script will automatically:
- Copy your notebook from original_template to the notebooks directory.
- Update the notebook's internal sections (like Installation, News) to ensure consistency.
- Add your notebook to the appropriate list in this README.md file.
Create a Pull Request: After that, just create a pull request (PR) to merge your changes, making it available for everyone!
- We appreciate your contributions and look forward to reviewing your notebooks!

Name		Name	Last commit message	Last commit date
Latest commit History 1,045 Commits
assets		assets
kaggle		kaggle
nb		nb
original_template		original_template
python_scripts		python_scripts
scripts		scripts
.gitattributes		.gitattributes
.gitignore		.gitignore
.python-version		.python-version
Dockerfile_DGX_Spark		Dockerfile_DGX_Spark
LICENSE		LICENSE
README.md		README.md
Template_Notebook.ipynb		Template_Notebook.ipynb
pyproject.toml		pyproject.toml
replace_text.py		replace_text.py
unsloth_windows.ps1		unsloth_windows.ps1
update_all_notebooks.py		update_all_notebooks.py
update_max_seq_length.py		update_max_seq_length.py
uv.lock		uv.lock

Folders and files

Latest commit

History

Repository files navigation

📒 Fine-tuning Notebooks

Main Notebooks

GRPO & Reinforcement Learning Notebooks

Tool Calling Notebooks

Text-to-Speech (TTS) Notebooks

Vision (Multimodal) Notebooks

Embedding Notebooks

Speech-to-Text (STT) Notebooks

OCR Notebooks

BERT Notebooks

Deepseek Notebooks

ERNIE Notebooks

GLM Notebooks

GPT-OSS Notebooks

Gemma 4 Notebooks

Gemma Notebooks

Granite Notebooks

Hybrid Attention Notebooks

Llama Notebooks

Mistral Notebooks

Nemotron Notebooks

Paddle Notebooks

Phi Notebooks

Qwen Notebooks

Text Completion / Continued Pretraining Notebooks

Specific use-case Notebooks

Other Notebooks

📒 Kaggle Notebooks

GRPO & Reinforcement Learning Notebooks

Tool Calling Notebooks

Text-to-Speech (TTS) Notebooks

Vision (Multimodal) Notebooks

Embedding Notebooks

Speech-to-Text (STT) Notebooks

OCR Notebooks

BERT Notebooks

Deepseek Notebooks

ERNIE Notebooks

GPT-OSS Notebooks

Gemma Notebooks

Granite Notebooks

Hybrid Attention Notebooks

Llama Notebooks

Mistral Notebooks

Nemotron Notebooks

Paddle Notebooks

Phi Notebooks

Qwen Notebooks

Text Completion / Continued Pretraining Notebooks

Other Notebooks

Known Issues / Environment Notes

✨ Contributing to Notebooks

About

Topics

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Uh oh!

Contributors

Uh oh!

Languages

Packages