Upon trying to connect to a machine with distant launch ssh://my.remote.ip.addr:port I get the following message:
Passphrase to decrypt /home/user/.ssh/key_file for [email protected]:
While using ssh directly does not prompt for the passphrase, because it correctly uses the running ssh-agent.