Skip to content

[Bug] Devnet script has problems with larger sets of validators. #3986

@kaimast

Description

@kaimast

🐛 Bug Report

I spawned a devnet with 10 validators:

~> ./scripts/devnet.sh
Enter the total number of validators (default: 4): 10
Enter the total number of clients (default: 2): 0
Enter the network ID (mainnet = 0, testnet = 1, canary = 2) (default: 1):
Do you want to run 'cargo install --locked --path .' to build the binary? (y/n, default: y): y
Do you want to clear the existing ledger history? (y/n, default: n): y
Do you want to enable validator telemetry? (y/n, default: y): n
Enter crate features to enable (comma separated, default: test_network):

They never fully connect or produce blocks. The script works more reliably with fewer validators but not always.

Below is a file containing all the errors generated in a short run:

.logs-20251031170157/validator-5.log:2025-11-01T00:02:31.008892Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56010 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:02:31.008946Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56010: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.038178Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56125 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.038300Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4132 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.038345Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4132: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.038458Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56125: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.039216Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4131 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.039250Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4131: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.042977Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56140 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.043078Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56140: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.043177Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4138 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-5.log:2025-11-01T00:04:11.043246Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4138: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-7.log:2025-11-01T00:03:21.024516Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:03:21.024655Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:03:21.026479Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4139 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:03:21.026760Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4139: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:03:46.023390Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:56029: Connection reset by peer (os error 54)
.logs-20251031170157/validator-7.log:2025-11-01T00:03:46.028311Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4138 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-7.log:2025-11-01T00:03:46.028361Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4138: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-7.log:2025-11-01T00:03:46.028492Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4133 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:03:46.029150Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4133: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-7.log:2025-11-01T00:04:11.041469Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4135: Connection reset by peer (os error 54)
.logs-20251031170157/validator-7.log:2025-11-01T00:04:11.041581Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56123 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-7.log:2025-11-01T00:04:11.041783Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56123: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:02:30.820473Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4134: Connection reset by peer (os error 54)
.logs-20251031170157/validator-6.log:2025-11-01T00:02:31.021988Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56019 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:02:31.022043Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56019: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:02:56.022176Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4138 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:02:56.022201Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4138: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:03:21.024314Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56059 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:03:21.024340Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56059: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:03:21.025133Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56057 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:03:21.025174Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56057: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:03:46.025017Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::writing: couldn't send a message to 127.0.0.1:4135: Broken pipe (os error 32)
.logs-20251031170157/validator-6.log:2025-11-01T00:03:46.027112Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4135: Connection reset by peer (os error 54)
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.036777Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't process a message from 127.0.0.1:56061: channel closed
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.039479Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56130 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.039672Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56130: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.039873Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4133 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.040407Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4133: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.042920Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56141 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043572Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56141: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043767Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56147 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043833Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56147: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043875Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4138 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043892Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4133 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043940Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4138: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-6.log:2025-11-01T00:04:11.043968Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4133: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-2.log:2025-11-01T00:02:30.999268Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't process a message from 127.0.0.1:55945: channel closed
.logs-20251031170157/validator-2.log:2025-11-01T00:03:46.025329Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56074 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-2.log:2025-11-01T00:03:46.025358Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56074: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-2.log:2025-11-01T00:04:11.037470Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't process a message from 127.0.0.1:56000: channel closed
.logs-20251031170157/validator-2.log:2025-11-01T00:04:11.037924Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56120 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-2.log:2025-11-01T00:04:11.038156Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56120: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:02:56.023486Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56041 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:02:56.023503Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56041: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:03:46.028566Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56094 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:03:46.028604Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56094: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.039249Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56116 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.039763Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56116: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.040479Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.040515Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.043776Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56145 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.043808Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56145: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.043875Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-3.log:2025-11-01T00:04:11.043949Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-1.log:2025-11-01T00:03:46.025675Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4132 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-1.log:2025-11-01T00:03:46.026816Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::writing: couldn't send a message to 127.0.0.1:56009: Broken pipe (os error 32)
.logs-20251031170157/validator-1.log:2025-11-01T00:03:46.027201Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4132: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-1.log:2025-11-01T00:04:11.038638Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56117 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-1.log:2025-11-01T00:04:11.038651Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4135 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-1.log:2025-11-01T00:04:11.038682Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56117: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-1.log:2025-11-01T00:04:11.039082Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4135: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-0.log:2025-11-01T00:03:46.043776Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:56004: Connection reset by peer (os error 54)
.logs-20251031170157/validator-0.log:2025-11-01T00:03:46.043816Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::writing: couldn't send a message to 127.0.0.1:56004: Broken pipe (os error 32)
.logs-20251031170157/validator-8.log:2025-11-01T00:02:31.002118Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4136: Connection reset by peer (os error 54)
.logs-20251031170157/validator-8.log:2025-11-01T00:02:31.021947Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:02:31.022007Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:02:56.022438Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56036 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:02:56.022655Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56036: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:02:56.023538Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4133 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-8.log:2025-11-01T00:02:56.023568Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4133: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-8.log:2025-11-01T00:03:21.023344Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4136: Connection reset by peer (os error 54)
.logs-20251031170157/validator-8.log:2025-11-01T00:03:46.028266Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56093 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:03:46.028291Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56093: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.039021Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::writing: couldn't send a message to 127.0.0.1:4132: Broken pipe (os error 32)
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.039512Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4132: Connection reset by peer (os error 54)
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.040815Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4137 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.041389Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4137: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043129Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56139 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043185Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56139: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043613Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56142 failed: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043641Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56142: Duplicate handshake attempt with '{addr}'
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043668Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043692Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043795Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4135 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-8.log:2025-11-01T00:04:11.043829Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4135: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:02:31.007674Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4131: Connection reset by peer (os error 54)
.logs-20251031170157/validator-9.log:2025-11-01T00:02:31.013381Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4135 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:02:31.013670Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4135: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:03:20.840183Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::reading: can't read from 127.0.0.1:4134: Connection reset by peer (os error 54)
.logs-20251031170157/validator-9.log:2025-11-01T00:03:21.025484Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:4136 failed: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:03:21.025897Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Unable to initiate a connection with 127.0.0.1:4136: the peer disconnected before sending "Message::ChallengeResponse", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:03:21.026715Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::protocols::handshake: handshake with 127.0.0.1:56063 failed: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown
.logs-20251031170157/validator-9.log:2025-11-01T00:03:21.026743Z ERROR tcp{�[3mname�[0m�[2m=�[0m"0"}: snarkos_node_tcp::tcp: Failed to connect with 127.0.0.1:56063: the peer disconnected before sending "Message::ChallengeRequest", likely due to peer saturation or shutdown

I did a quick git bisect and the first bad commit seems to be 0ecfd99 .

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugIncorrect or unexpected behavior

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions