-
Notifications
You must be signed in to change notification settings - Fork 16
Description
Problem
The node currently hardcodes a single worker per validator (worker_id = 0). The EpochManager, network layer, and several initialization paths assume exactly one worker. This blocks the ability to run independent fee markets, specialized transaction pools, or any form of worker-level parallelism.
Goal
Refactor the node to support N independent workers per validator. Each worker operates as a standalone unit with its own:
- libp2p swarm (dedicated gossip topics, listen address, network key)
- RPC server (unique port)
- Transaction pool
- Batch builder + batch validator
LocalNetworkinstance for primary communication
Workers share only the Primary (consensus) and the execution engine (block production). The num_workers count is a consensus-level parameter — all validators must agree on it.
Why
The immediate motivation is multiple fee markets. Once multi-worker is in place, a follow-up (Phase 2) spawns 2 workers by default:
- Worker 0 (General): accepts all transactions, standard EIP-1559 fee market
- Worker 1 (Whitelisted Transfers): accepts only whitelisted ERC-20
transfer/transferFromcalls, operates with a reduced base fee
This architecture also enables future process separation — workers can be extracted into standalone processes communicating with the primary over RPC. They can even support multiple execution environments.
Design Constraints
- Workers are fully independent — no cross-worker shared state. Each worker has its own network identity, pool, and gossip topics.
- Per-worker gossip topics —
tn-worker-{id}andtn-txn-{id}replace the current globaltn-workerandtn-txntopics. This provides network-level isolation. - Per-worker
LocalNetwork— each worker gets its ownLocalNetworkinstance for primary communication. The primary registers as the handler on every worker'sLocalNetwork. This is the seam for future process separation. num_workersis a consensus parameter — changing it requires a coordinated upgrade across all validators. Defaults to1for backward compatibility.- Execution engine is shared — batches from all workers are processed sequentially by the same engine. Worker ID is already encoded in the block
difficultyfield. - Faucet on worker 0 only — the testnet faucet attaches to the general-purpose worker.
Current State
Much of the infrastructure already supports N workers but is only called with worker_id = 0:
ExecutionNodeInner.workers: Vec<WorkerComponents>— vec exists, only 1 elementGasAccumulator— supports N workers internally, but initialized withnew(1)BatchValidator— already storesworker_idand rejects mismatched batchesadjust_base_fees()— loops overnum_workers()but is a no-op- Block
difficultyfield — already encodesbatch_index << 16 | worker_id
Hardcoded locations that block multi-worker:
| Location | Current | Fix |
|---|---|---|
manager.rs spawn_worker_node_components() |
let worker_id = 0; |
Loop over 0..num_workers |
manager.rs GasAccumulator::new(1) |
Hardcoded 1 worker | Use num_workers |
manager.rs catchup_accumulator() |
gas_accumulator.base_fee(0) |
Restore per-worker base fees |
manager.rs EpochManager struct |
Singular worker_network_handle |
Vec<WorkerNetworkHandle> |
manager.rs create_consensus() |
Returns (PrimaryNode, WorkerNode) |
Returns (PrimaryNode, Vec<WorkerNode>) |
config/genesis.rs NodeP2pInfo |
Single worker: NetworkInfo |
workers: Vec<NetworkInfo> |
config/node.rs Parameters |
No num_workers field |
Add num_workers: u16 (default 1) |
config/network.rs |
Global topics tn-worker, tn-txn |
Per-worker tn-worker-{id}, tn-txn-{id} |
config/consensus.rs |
Single LocalNetwork |
Vec<LocalNetwork> |
This PR: Configuration (foundation — must land first)
This PR lays the configuration foundation that all subsequent multi-worker PRs build on. It changes data structures and configuration to support multiple workers while defaulting to 1 (preserving current behavior).
Scope
crates/config/src/genesis.rs — NodeP2pInfo:
- Change
NodeP2pInfo.workerfromNetworkInfotoworkers: Vec<NetworkInfo>(one entry per worker) - Update
NodeInfo::worker_network_address()to take aWorkerIdparameter - Update
NodeInfo::worker_network_key()to take aWorkerIdparameter - Add
NodeInfo::num_workers() -> usizethat returnsself.p2p_info.workers.len() - Update
Defaultimpl to create a single-element vec (backward compatible) - Update
NetworkGenesis::validate()to ensure all validators have the same number of workers
crates/config/src/node.rs — Parameters:
- Add
num_workers: u16field with#[serde(default = "default_num_workers")]wheredefault_num_workers() -> u16 { 1 } - All nodes must agree on this value; changing it requires a coordinated upgrade
crates/config/src/node.rs — Config:
- Add convenience method
Config::num_workers() -> u16delegating toself.parameters.num_workers
crates/config/src/network.rs — LibP2pConfig topics:
- Change
worker_batch_topic()toworker_batch_topic(worker_id: WorkerId) -> Stringreturningformat!("tn-worker-{worker_id}") - Change
worker_txn_topic()toworker_txn_topic(worker_id: WorkerId) -> Stringreturningformat!("tn-txn-{worker_id}")
Genesis / test fixtures:
- Update YAML genesis and committee files to use the new vec format for workers
- Update
crates/test-utils-committee/src/builder.rsto generate per-worker network info