Switch to A100-40GB for better memory bandwidth

baogorek · baogorek · commit 8361249d5f6d · 2026-01-17T11:25:39.000-05:00
diff --git a/modal_app/fit_weights.py b/modal_app/fit_weights.py
@@ -20,7 +20,7 @@
     secrets=[hf_secret],
     memory=32768,
     cpu=4.0,
-    gpu="T4",
+    gpu="A100-40GB",
     timeout=14400,
 )
 def fit_weights(branch: str = "main", epochs: int = 200) -> bytes:

Original file line number	Diff line number	Diff line change
`@@ -20,7 +20,7 @@`
`20`	`20`	`secrets=[hf_secret],`
`21`	`21`	`memory=32768,`
`22`	`22`	`cpu=4.0,`
`23`		`- gpu="T4",`
	`23`	`+ gpu="A100-40GB",`
`24`	`24`	`timeout=14400,`
`25`	`25`	`)`
`26`	`26`	`def fit_weights(branch: str = "main", epochs: int = 200) -> bytes:`