Skip to content

Commit 908dd2f

Browse files
authored
PyTorch tips for better training performance (rasbt#525)
* PyTorch tips for better training performance * formatting * pep 8
1 parent 3c29b67 commit 908dd2f

File tree

6 files changed

+1853
-0
lines changed

6 files changed

+1853
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -121,6 +121,7 @@ Several folders contain optional materials as a bonus for interested readers:
121121
- [Llama 3.2 From Scratch](ch05/07_gpt_to_llama/standalone-llama32.ipynb)
122122
- [Memory-efficient Model Weight Loading](ch05/08_memory_efficient_weight_loading/memory-efficient-state-dict.ipynb)
123123
- [Extending the Tiktoken BPE Tokenizer with New Tokens](ch05/09_extending-tokenizers/extend-tiktoken.ipynb)
124+
- [PyTorch Performance Tips for Faster LLM Training](ch05/10_llm-training-speed)
124125
- **Chapter 6: Finetuning for classification**
125126
- [Additional experiments finetuning different layers and using larger models](ch06/02_bonus_additional-experiments)
126127
- [Finetuning different models on 50k IMDB movie review dataset](ch06/03_bonus_imdb-classification)

0 commit comments

Comments
 (0)