Skip to content

Commit 428142c

Browse files
ntnyHumairAK
andauthored
Update proposals/separate-standalone-driver/README.md
fix description Co-authored-by: Humair Khan <[email protected]> Signed-off-by: Anton Pechenin <[email protected]>
1 parent cb544ab commit 428142c

File tree

1 file changed

+1
-1
lines changed
  • proposals/separate-standalone-driver

1 file changed

+1
-1
lines changed

proposals/separate-standalone-driver/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -177,7 +177,7 @@ The sample of the Argo Workflow system-container-driver template based on plugin
177177
178178
## Conclusion
179179
This proposal introduces an optimization for Kubeflow Pipelines (KFP) that replaces per-task driver pods with a lightweight standalone service based on Argo Workflows’ Executor Plugin mechanism. It significantly reduces pipeline task startup time by eliminating the overhead of scheduling a separate driver pod for each task — particularly beneficial for large pipelines with multiple steps and caching enabled.
180-
Instead of launching a new driver pod per task, the driver logic is offloaded to a shared sidecar container (agent pod) within the workflow. This reduces latency in cache lookups and metadata initialization.
180+
Instead of launching a new driver pod per task, the driver logic is offloaded to a shared agent pod that is scheduled per workflow, and completes once the workflow ends. This reduces latency in cache lookups and metadata initialization.
181181
However, this approach does not fully eliminate pod scheduling issues: the standalone driver is not a global service, but is instantiated per workflow. Thus, a pod still needs to be scheduled for each workflow run.
182182
183183
## Disadvantages:

0 commit comments

Comments
 (0)