Cannot establish connection with peers

[Priceless-P]

Hello everyone,

I'm building a peer-to-peer application using libp2p. My application connects desktop peers (built with Tauri) and a browser peer. Initially, desktop-to-desktop connections over TCP worked fine. But after adding WebRTC support for browser connections, the desktop-to-desktop TCP connections stopped working, and the browser-to-desktop connection still doesn't work.

I want desktop nodes to continue using TCP, while browser nodes use WebRTC. Or, if possible, I'd like to switch everything to WebRTC for both desktop and browser nodes.

This is the error I usually get:

IncomingConnectionError { connection_id: ConnectionId(2), local_addr: /ip4/127.0.0.1/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A, send_back_addr: /ip4/127.0.0.1/udp/52933/webrtc-direct, error: Transport(Other(Custom { kind: Other, error: Timeout })) }

or something about the data channel taking more than 10 secs to open.

Here's a snippet of the code where I set up the transports:

let mut swarm = SwarmBuilder::with_existing_identity(id_keys)
    .with_tokio()
    .with_tcp(
        tcp::Config::default(),
        noise::Config::new,
        yamux::Config::default,
    )?
    .with_other_transport(|id_keys| {
        Ok(webrtc::tokio::Transport::new(
            id_keys.clone(),
            cert.expect("Error"),
        )
        .map(|(peer_id, conn), _| (peer_id, StreamMuxerBox::new(conn))))
    })?
    .with_behaviour(|key| Behaviour {
        kademlia: kad::Behaviour::new(peer_id, MemoryStore::new(key.public().to_peer_id())),
        mdns: mdns::tokio::Behaviour::new(
            mdns::Config::default(),
            key.public().to_peer_id(),
        )
        .expect("Error"),
        bitswap: beetswap::Behaviour::new(blockstore.clone()),
    })?
    .with_swarm_config(|cfg| {
        cfg.with_idle_connection_timeout(Duration::from_secs(u64::MAX))
    })
    .build();

let address_webrtc = Multiaddr::from(Ipv4Addr::new(127, 0, 0, 1))
    .with(Protocol::Udp(9090))
    .with(Protocol::WebRTCDirect);

swarm.listen_on(address_webrtc).expect("Error listening on WebRTC address");

The complete code is here

Any help or suggestion on how to fix this will be highly appreciated. Thank you in advance!

[dariusc93]

Hey! could you provide the full logs to both ends when you are dialing the peer?

[Priceless-P]

Hi @dariusc93! Here it is

Node A:

2024-10-10T17:14:20.940421Z  INFO libp2p_swarm: local_peer_id=12D3KooWSYeFNcKJatgkoD9N3dFz9wcDjeJjf7BAQmyMjcb61scF
2024-10-10T17:14:20.950272Z  INFO libp2p_mdns::behaviour::iface: creating instance on iface address address=172.20.10.3
Did not match any specific event: NewListenAddr { listener_id: ListenerId(1), address: /ip4/127.0.0.1/udp/9090/webrtc-direct/certhash/uEiA__ZrsUTEit8jKpEkDtVBNfAIsEgld15Dox1Gs_WoZvw }
2024-10-10T17:14:21.454592Z  WARN libp2p_kad::behaviour: Failed to trigger bootstrap: No known peers.
2024-10-10T17:18:13.748667Z  INFO libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ address=/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Discovered Peer: /ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Discovered peer via Kademlia: PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ") at /ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Dialing peer: PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")
2024-10-10T17:18:13.777290Z  INFO webrtc_ice::mdns: mDNS is using 0.0.0.0:5353 as dest_addr
2024-10-10T17:18:13.777303Z  INFO webrtc_ice::mdns: mDNS is using 0.0.0.0:5353 as dest_addr
2024-10-10T17:18:13.797610Z  INFO webrtc_mdns::conn: Looping and listening Ok(0.0.0.0:5353)
2024-10-10T17:18:13.797614Z  INFO webrtc_mdns::conn: Looping and listening Ok(0.0.0.0:5353)
2024-10-10T17:18:13.801500Z  INFO webrtc::peer_connection: signaling state changed to have-local-offer
2024-10-10T17:18:13.801500Z  INFO webrtc::peer_connection: signaling state changed to have-local-offer
2024-10-10T17:18:13.805156Z  INFO webrtc::peer_connection: signaling state changed to stable
2024-10-10T17:18:13.805604Z  INFO webrtc::peer_connection: signaling state changed to stable
2024-10-10T17:18:13.808917Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Checking
2024-10-10T17:18:13.808917Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Checking
2024-10-10T17:18:13.809570Z  INFO webrtc::peer_connection: ICE connection state changed: checking
2024-10-10T17:18:13.810452Z  INFO webrtc::peer_connection: ICE connection state changed: checking
Failed to connect to peer: Some(PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")), error: Transport([(/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ, Other(Custom { kind: Other, error: Timeout }))])
Failed to connect to peer: Some(PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")), error: Transport([(/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ, Other(Custom { kind: Other, error: Timeout }))])
2024-10-10T17:18:43.867778Z  WARN webrtc_ice::agent::agent_internal: [controlling]: Failed to close candidate udp4 host 172.20.10.14:9090: the agent is closed
2024-10-10T17:18:43.867808Z  WARN webrtc_ice::agent::agent_internal: [controlling]: Failed to close candidate udp4 host 172.20.10.14:9090: the agent is closed
2024-10-10T17:18:43.869058Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Failed
2024-10-10T17:18:43.873885Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Failed
2024-10-10T17:18:43.876491Z  INFO webrtc::peer_connection: ICE connection state changed: failed
2024-10-10T17:18:43.879239Z  INFO webrtc::peer_connection: ICE connection state changed: failed
.....

Node B

2024-10-10T17:14:20.940421Z  INFO libp2p_swarm: local_peer_id=12D3KooWSYeFNcKJatgkoD9N3dFz9wcDjeJjf7BAQmyMjcb61scF
2024-10-10T17:14:20.950272Z  INFO libp2p_mdns::behaviour::iface: creating instance on iface address address=172.20.10.3
Did not match any specific event: NewListenAddr { listener_id: ListenerId(1), address: /ip4/127.0.0.1/udp/9090/webrtc-direct/certhash/uEiA__ZrsUTEit8jKpEkDtVBNfAIsEgld15Dox1Gs_WoZvw }
2024-10-10T17:14:21.454592Z  WARN libp2p_kad::behaviour: Failed to trigger bootstrap: No known peers.
2024-10-10T17:18:13.748667Z  INFO libp2p_mdns::behaviour: discovered peer on address peer=12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ address=/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Discovered Peer: /ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Discovered peer via Kademlia: PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ") at /ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ
Dialing peer: PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")
2024-10-10T17:18:13.777290Z  INFO webrtc_ice::mdns: mDNS is using 0.0.0.0:5353 as dest_addr
2024-10-10T17:18:13.777303Z  INFO webrtc_ice::mdns: mDNS is using 0.0.0.0:5353 as dest_addr
2024-10-10T17:18:13.797610Z  INFO webrtc_mdns::conn: Looping and listening Ok(0.0.0.0:5353)
2024-10-10T17:18:13.797614Z  INFO webrtc_mdns::conn: Looping and listening Ok(0.0.0.0:5353)
2024-10-10T17:18:13.801500Z  INFO webrtc::peer_connection: signaling state changed to have-local-offer
2024-10-10T17:18:13.801500Z  INFO webrtc::peer_connection: signaling state changed to have-local-offer
2024-10-10T17:18:13.805156Z  INFO webrtc::peer_connection: signaling state changed to stable
2024-10-10T17:18:13.805604Z  INFO webrtc::peer_connection: signaling state changed to stable
2024-10-10T17:18:13.808917Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Checking
2024-10-10T17:18:13.808917Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Checking
2024-10-10T17:18:13.809570Z  INFO webrtc::peer_connection: ICE connection state changed: checking
2024-10-10T17:18:13.810452Z  INFO webrtc::peer_connection: ICE connection state changed: checking
Failed to connect to peer: Some(PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")), error: Transport([(/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ, Other(Custom { kind: Other, error: Timeout }))])
Failed to connect to peer: Some(PeerId("12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ")), error: Transport([(/ip4/172.20.10.14/udp/9090/webrtc-direct/certhash/uEiCRP6gZ_kUSaty9Wv6Z70NkNar6z69lroHb7kMJxBBJ8A/p2p/12D3KooWEC47e2xUYXevKzj31nJ2p812PeiiDtCmFcfVfrQfqQRQ, Other(Custom { kind: Other, error: Timeout }))])
2024-10-10T17:18:43.867778Z  WARN webrtc_ice::agent::agent_internal: [controlling]: Failed to close candidate udp4 host 172.20.10.14:9090: the agent is closed
2024-10-10T17:18:43.867808Z  WARN webrtc_ice::agent::agent_internal: [controlling]: Failed to close candidate udp4 host 172.20.10.14:9090: the agent is closed
2024-10-10T17:18:43.869058Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Failed
2024-10-10T17:18:43.873885Z  INFO webrtc_ice::agent::agent_internal: [controlling]: Setting new connection state: Failed
2024-10-10T17:18:43.876491Z  INFO webrtc::peer_connection: ICE connection state changed: failed
2024-10-10T17:18:43.879239Z  INFO webrtc::peer_connection: ICE connection state changed: failed
.....

[jxs]

Hi! Yeah the WebRTC transport is known to be flaky see more info here.
But your logs don't show connections failed with TCP afais right? Can you show how you are dialing the desktop peers?