-
Notifications
You must be signed in to change notification settings - Fork 147
Description
SUMMARY
I'm trying to run a local environment with a validator node and a seed node but I can't make they talk each other.
ISSUE TYPE
- Bug Report
COMPONENT NAME
p2p/discovery/bootstrap, cometbft:p2p
OASIS NODE VERSION
25.9
OS / ENVIRONMENT
Ubuntu Linux
I'm not compiling the oasis-core.
STEPS TO REPRODUCE
I did setup a single validator node and a seed node (same genesis.json)
In order to prepare the seed address string I did get the seed ID is two ways:
oasis-node control status -a unix:internal.sock | jq .identity.node -r(return:zTZ19RU1WtAnHtUrqEcG+Hp8QNo8yysm0Cdf4anxx7A=)oasis-node identity cometbft show-node-address --datadir /node/data(return:A7A1636A57BC399F1C5E1B9A642A234BE2F9C151)
I did try both ways on the validator's config file:
ACTUAL RESULTS
When I did try using A7A1636A57BC399F1C5E1B9A642A234BE2F9C151 the validator terminates just after starting it:
{"caller":"common.go:139","level":"debug","module":"oasis-node","msg":"common initialization complete","ts":"2025-12-19T20:08:08.929149686Z"}
{"caller":"node.go:415","level":"info","mode":"validator","module":"oasis-node","msg":"Starting oasis-node","ts":"2025-12-19T20:08:08.929217143Z","version":"25.9"}
{"caller":"init.go:73","consensus_pk":"MRFYuWUjALfbMhAZ83++gCZKM4Z0vMO+SgVUHunzsq0=","level":"info","module":"oasis-node","msg":"loaded/generated node identity","node_pk":"48LeX3cRyPaKQ0vIxRcdAqnq4cWuBm7m/jUvvR1C1RE=","p2p_pk":"v0YUg96kEWAE/rYWyFmXazjKD4TtZLDi2BN3oIAeW3w=","tls_pk":"+2sB1VFsmNV2QTASErVgK5dHD+FLEqdHckK3EIwz7vg=","ts":"2025-12-19T20:08:08.935707098Z"}
{"caller":"component.go:34","level":"info","module":"grpc","msg":"[core] [Server #1]Server created\n","ts":"2025-12-19T20:08:08.940012965Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"All 2 tables opened in 0s","ts":"2025-12-19T20:08:08.944603776Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Discard stats nextEmptySlot: 0","ts":"2025-12-19T20:08:08.946154921Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Set nextTxnTs to 12311","ts":"2025-12-19T20:08:08.946198172Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Deleting empty file: /node/validator-node/persistent-store.badger.db/000035.vlog","ts":"2025-12-19T20:08:08.94628824Z"}
{"caller":"service_manager.go:102","level":"debug","module":"oasis-node","msg":"beginning cleanup","ts":"2025-12-19T20:08:08.946677854Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"metrics","ts":"2025-12-19T20:08:08.946708325Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"pprof","ts":"2025-12-19T20:08:08.946729643Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"grpc/internal","ts":"2025-12-19T20:08:08.94674793Z"}
{"caller":"service_manager.go:111","level":"debug","module":"oasis-node","msg":"finished cleanup","ts":"2025-12-19T20:08:08.946765666Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Lifetime L0 stalled for: 0s","ts":"2025-12-19T20:08:08.946791374Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Level 0 [ ]: NumTables: 01. Size: 17 KiB of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 64 MiB\nLevel 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 4 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 5 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 6 [B]: NumTables: 01. Size: 464 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel Done","ts":"2025-12-19T20:08:08.949506616Z"}
When I did try using zTZ19RU1WtAnHtUrqEcG+Hp8QNo8yysm0Cdf4anxx7A= the communication fails:
validator's log (revelant lines)
{"caller":"client.go:128","err":"call failed on all peers","level":"error","module":"p2p/discovery/bootstrap","msg":"failed to advertise","seed_addrs":["/ip4/13.39.160.93/tcp/26656"],"seed_id":"12D3KooWPdRus1KQmsWQLBaCpNZtTVvwZydLUyTR6hUjom5VZCbq","ts":"2025-12-19T20:09:02.641646493Z"}
{"caller":"pex_reactor.go:522","level":"info","module":"cometbft:pex","msg":"No addresses to dial. Falling back to seeds","ts":"2025-12-19T20:09:02.895747321Z"}
{"caller":"pex_reactor.go:623","err":"auth failure: conn.ID (a7a1636a57bc399f1c5e1b9a642a234be2f9c151) dialed ID (05d8296da181bd32d992e0aa10f90fceeaa2a14c) mismatch","level":"error","module":"cometbft:p2p","msg":"Error dialing seed","seed":"[email protected]:26656","ts":"2025-12-19T20:09:02.897671517Z"}
{"caller":"pex_reactor.go:627","level":"error","module":"cometbft:p2p","msg":"Couldn't connect to any seeds","ts":"2025-12-19T20:09:02.897711666Z"}
{"caller":"client.go:196","err":"call failed on all peers","level":"error","module":"p2p/discovery/bootstrap","msg":"failed to call seed node","seed_addrs":["/ip4/13.39.160.93/tcp/26656"],"seed_id":"12D3KooWPdRus1KQmsWQLBaCpNZtTVvwZydLUyTR6hUjom5VZCbq","ts":"2025-12-19T20:09:03.589555744Z"}
seed's log
{"caller":"switch.go:655","err":"auth failure: secret conn failed: proto: illegal wireType 7","level":"info","module":"cometbft:switch","msg":"Inbound Peer rejected","numPeers":0,"ts":"2025-12-19T20:09:02.593328605Z"}
{"caller":"switch.go:655","err":"auth failure: handshake failed: EOF","level":"info","module":"cometbft:switch","msg":"Inbound Peer rejected","numPeers":0,"ts":"2025-12-19T20:09:02.898061375Z"}
{"caller":"file.go:22","level":"info","module":"cometbft:book","msg":"Saving AddrBook to file","size":1,"ts":"2025-12-19T20:10:39.657929193Z"}
EXPECTED RESULTS
It should work
FURTHER NOTES
From this line here {"caller":"pex_reactor.go:623","err":"auth failure: conn.ID (a7a1636a57bc399f1c5e1b9a642a234be2f9c151) dialed ID (05d8296da181bd32d992e0aa10f90fceeaa2a14c). I suppose the validator's config.yml` expects the seed ID in the Tendermint format only, but when handshaking with the seed node, it expects the CometBFT format.