Adding an extra slice to the Pathways cluster to swap in when there is a slice failure

lukebaumann · lukebaumann · commit 253d77f2ba7e · 2025-07-24T22:38:26.000Z
diff --git a/axlearn/cloud/gcp/pathways_utils.py b/axlearn/cloud/gcp/pathways_utils.py
@@ -593,7 +593,7 @@ def __call__(self) -> Sequence[Nested[Any]]:
             ),
             dict(
                 name=_PATHWAYS_WORKER_REPLICATED_JOB_NAME,
-                replicas=cfg.accelerator.num_replicas,
+                replicas=cfg.accelerator.num_replicas + 1,
                 template=self._build_pathways_worker_job(),
             ),
         ]

Original file line number	Diff line number	Diff line change
`@@ -593,7 +593,7 @@ def __call__(self) -> Sequence[Nested[Any]]:`
`593`	`593`	`),`
`594`	`594`	`dict(`
`595`	`595`	`name=_PATHWAYS_WORKER_REPLICATED_JOB_NAME,`
`596`		`- replicas=cfg.accelerator.num_replicas,`
	`596`	`+ replicas=cfg.accelerator.num_replicas + 1,`
`597`	`597`	`template=self._build_pathways_worker_job(),`
`598`	`598`	`),`
`599`	`599`	`]`