Skip to content

feat(cli): add --mode flag to dora build for parallel/sequential builds#1573

Open
swar09 wants to merge 4 commits intodora-rs:mainfrom
swar09:feat-dora-build
Open

feat(cli): add --mode flag to dora build for parallel/sequential builds#1573
swar09 wants to merge 4 commits intodora-rs:mainfrom
swar09:feat-dora-build

Conversation

@swar09
Copy link
Copy Markdown
Contributor

@swar09 swar09 commented Mar 29, 2026

Summary

Closes #1570

As of now, dora build dataflow.yml builds nodes one at a time. This is safe for low-spec hardware but wastes time on capable development machines. This PR adds a --mode flag to dora build so users can opt into parallel building.

Usage

# Sequential (current default behavior, backward compatible)
dora build dataflow.yml

# Explicitly sequential
dora build --mode sequential dataflow.yml

# Parallel (faster on capable machines)
dora build --mode parallel dataflow.yml

Note

The feature is most valuable for use cases like dataflows with Python, Rust, and C/C++ nodes from separate projects.
Works for Any combination of independent build commands.
For a pure Rust workspace with all nodes inside it, the gain is minimal because Cargo itself serializes via locks.

@swar09
Copy link
Copy Markdown
Contributor Author

swar09 commented Mar 31, 2026

I have figured out the issue which cause CI failure i will update soon .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Configurable Build Mode Parallel vs Sequential

1 participant