Add llama 3.1 to dist_run.py

mreso · mreso · commit e8bb0764c4d9 · 2024-10-17T13:55:42.000-07:00
diff --git a/dist_run.py b/dist_run.py
@@ -57,6 +57,7 @@
 NAME_TO_DISTRIBUTION_AND_DTYPE = {
     "llama2-7b-chat": ("meta-llama/Llama-2-7b-chat-hf", torch.float16),
     "llama3": ("meta-llama/Meta-Llama-3-8B-Instruct", torch.bfloat16),
+    "llama3.1": ("meta-llama/Meta-Llama-3.1-8B-Instruct", torch.bfloat16),
 }
 
 

Original file line number	Diff line number	Diff line change
`@@ -57,6 +57,7 @@`
`57`	`57`	`NAME_TO_DISTRIBUTION_AND_DTYPE = {`
`58`	`58`	`"llama2-7b-chat": ("meta-llama/Llama-2-7b-chat-hf", torch.float16),`
`59`	`59`	`"llama3": ("meta-llama/Meta-Llama-3-8B-Instruct", torch.bfloat16),`
	`60`	`+ "llama3.1": ("meta-llama/Meta-Llama-3.1-8B-Instruct", torch.bfloat16),`
`60`	`61`	`}`
`61`	`62`
`62`	`63`