Skip to content

Not able to connect to a seed node #6438

@marcelomorgado

Description

@marcelomorgado
SUMMARY

I'm trying to run a local environment with a validator node and a seed node but I can't make they talk each other.

ISSUE TYPE
  • Bug Report
COMPONENT NAME

p2p/discovery/bootstrap, cometbft:p2p

OASIS NODE VERSION
25.9
OS / ENVIRONMENT

Ubuntu Linux
I'm not compiling the oasis-core.

STEPS TO REPRODUCE

I did setup a single validator node and a seed node (same genesis.json)
In order to prepare the seed address string I did get the seed ID is two ways:

  1. oasis-node control status -a unix:internal.sock | jq .identity.node -r (return: zTZ19RU1WtAnHtUrqEcG+Hp8QNo8yysm0Cdf4anxx7A=)
  2. oasis-node identity cometbft show-node-address --datadir /node/data (return: A7A1636A57BC399F1C5E1B9A642A234BE2F9C151)

I did try both ways on the validator's config file:

ACTUAL RESULTS

When I did try using A7A1636A57BC399F1C5E1B9A642A234BE2F9C151 the validator terminates just after starting it:

{"caller":"common.go:139","level":"debug","module":"oasis-node","msg":"common initialization complete","ts":"2025-12-19T20:08:08.929149686Z"}
{"caller":"node.go:415","level":"info","mode":"validator","module":"oasis-node","msg":"Starting oasis-node","ts":"2025-12-19T20:08:08.929217143Z","version":"25.9"}
{"caller":"init.go:73","consensus_pk":"MRFYuWUjALfbMhAZ83++gCZKM4Z0vMO+SgVUHunzsq0=","level":"info","module":"oasis-node","msg":"loaded/generated node identity","node_pk":"48LeX3cRyPaKQ0vIxRcdAqnq4cWuBm7m/jUvvR1C1RE=","p2p_pk":"v0YUg96kEWAE/rYWyFmXazjKD4TtZLDi2BN3oIAeW3w=","tls_pk":"+2sB1VFsmNV2QTASErVgK5dHD+FLEqdHckK3EIwz7vg=","ts":"2025-12-19T20:08:08.935707098Z"}
{"caller":"component.go:34","level":"info","module":"grpc","msg":"[core] [Server #1]Server created\n","ts":"2025-12-19T20:08:08.940012965Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"All 2 tables opened in 0s","ts":"2025-12-19T20:08:08.944603776Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Discard stats nextEmptySlot: 0","ts":"2025-12-19T20:08:08.946154921Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Set nextTxnTs to 12311","ts":"2025-12-19T20:08:08.946198172Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Deleting empty file: /node/validator-node/persistent-store.badger.db/000035.vlog","ts":"2025-12-19T20:08:08.94628824Z"}
{"caller":"service_manager.go:102","level":"debug","module":"oasis-node","msg":"beginning cleanup","ts":"2025-12-19T20:08:08.946677854Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"metrics","ts":"2025-12-19T20:08:08.946708325Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"pprof","ts":"2025-12-19T20:08:08.946729643Z"}
{"caller":"service_manager.go:105","level":"debug","module":"oasis-node","msg":"cleaning up","svc":"grpc/internal","ts":"2025-12-19T20:08:08.94674793Z"}
{"caller":"service_manager.go:111","level":"debug","module":"oasis-node","msg":"finished cleanup","ts":"2025-12-19T20:08:08.946765666Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Lifetime L0 stalled for: 0s","ts":"2025-12-19T20:08:08.946791374Z"}
{"caller":"helpers.go:41","level":"info","module":"common/persistent","msg":"Level 0 [ ]: NumTables: 01. Size: 17 KiB of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 64 MiB\nLevel 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 4 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 5 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 6 [B]: NumTables: 01. Size: 464 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel Done","ts":"2025-12-19T20:08:08.949506616Z"}

When I did try using zTZ19RU1WtAnHtUrqEcG+Hp8QNo8yysm0Cdf4anxx7A= the communication fails:

validator's log (revelant lines)

{"caller":"client.go:128","err":"call failed on all peers","level":"error","module":"p2p/discovery/bootstrap","msg":"failed to advertise","seed_addrs":["/ip4/13.39.160.93/tcp/26656"],"seed_id":"12D3KooWPdRus1KQmsWQLBaCpNZtTVvwZydLUyTR6hUjom5VZCbq","ts":"2025-12-19T20:09:02.641646493Z"}
{"caller":"pex_reactor.go:522","level":"info","module":"cometbft:pex","msg":"No addresses to dial. Falling back to seeds","ts":"2025-12-19T20:09:02.895747321Z"}
{"caller":"pex_reactor.go:623","err":"auth failure: conn.ID (a7a1636a57bc399f1c5e1b9a642a234be2f9c151) dialed ID (05d8296da181bd32d992e0aa10f90fceeaa2a14c) mismatch","level":"error","module":"cometbft:p2p","msg":"Error dialing seed","seed":"[email protected]:26656","ts":"2025-12-19T20:09:02.897671517Z"}
{"caller":"pex_reactor.go:627","level":"error","module":"cometbft:p2p","msg":"Couldn't connect to any seeds","ts":"2025-12-19T20:09:02.897711666Z"}
{"caller":"client.go:196","err":"call failed on all peers","level":"error","module":"p2p/discovery/bootstrap","msg":"failed to call seed node","seed_addrs":["/ip4/13.39.160.93/tcp/26656"],"seed_id":"12D3KooWPdRus1KQmsWQLBaCpNZtTVvwZydLUyTR6hUjom5VZCbq","ts":"2025-12-19T20:09:03.589555744Z"}

seed's log

{"caller":"switch.go:655","err":"auth failure: secret conn failed: proto: illegal wireType 7","level":"info","module":"cometbft:switch","msg":"Inbound Peer rejected","numPeers":0,"ts":"2025-12-19T20:09:02.593328605Z"}
{"caller":"switch.go:655","err":"auth failure: handshake failed: EOF","level":"info","module":"cometbft:switch","msg":"Inbound Peer rejected","numPeers":0,"ts":"2025-12-19T20:09:02.898061375Z"}
{"caller":"file.go:22","level":"info","module":"cometbft:book","msg":"Saving AddrBook to file","size":1,"ts":"2025-12-19T20:10:39.657929193Z"}
EXPECTED RESULTS

It should work

FURTHER NOTES

From this line here {"caller":"pex_reactor.go:623","err":"auth failure: conn.ID (a7a1636a57bc399f1c5e1b9a642a234be2f9c151) dialed ID (05d8296da181bd32d992e0aa10f90fceeaa2a14c). I suppose the validator's config.yml` expects the seed ID in the Tendermint format only, but when handshaking with the seed node, it expects the CometBFT format.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions