Exercises for the lab sessions of AthNLP 2025. Everything has been setup to run from a Jupyter Notebook/Google Colab.
The labs will cover the following topics:
Lab | Topic | Task | Solutions |
---|---|---|---|
0 | Preliminaries: Word Embeddings & Preprocessing, nn.module Anatomy, Tensor Operations |
labs/athnlp_lab_0.ipynb |
|
1 | Text Classification | labs/athnlp_lab_1.ipynb |
|
2 | Language Modeling from Scratch | labs/athnlp_lab_2.ipynb |
|
3 | Transformers and Attention | labs/athnlp_lab_3.ipynb |
|
4 | Neural Machine Translation | labs/athnlp_lab_4.ipynb |
|
5 | Prompt Engineering with LLMs | labs/athnlp-lab5.ipynb |
|
6 | LLM Agents | labs/athnlp_lab_6.ipynb |
Here is a quick list of some useful tutorials to get you up to speed with Python, Numpy and Pytorch:
- Introduction to Python
- Introduction to Numpy
- Introduction to PyTorch from the official PyTorch website:
- Tensor Broadcasting Puzzles: https://github.com/srush/Tensor-Puzzles