draft structure

Author: divnori

xtra_labs/llm_finetune/draft.py

@@ -0,0 +1,34 @@
+"""
+Drafting lab flow in script format using PyTorch
+"""
+
+# Part 1
+
+# Load pretrained LLM (medium size model)
+
+# Function for next token prediction
+
+# Call in loop for autoregressive inference
+
+# Evaluate model on benchmark dataset
+
+# Do the same for small and large models
+
+# Spider plot
+
+
+# Part 2
+
+# new LoRA linear layer class
+
+# new attention layer class
+
+# replace attention modules with new module
+
+# load chat dataset
+
+# train model
+
+# evaluate finetuned model on benchmark
+
+# add to spider plot