Claiming "outcome": "UNCLAIMED" after recovery

[tempo-beme]

Hi,

I have been practicing recovering a node after a failure on testnet but have hit a roadblock.

I had a lnd node where I have been backing up the channel.backup file. This node had three open channels. I shut down the node and then attempted to restore it by

1. starting a new lnd instance
2. creating a new wallet with the seed phrase from the wallet being restored
3. running restorechanbackup and passing in the channel.backup file

This managed to find the previous channels and force close them, I think? However, my channelbalance has the balance of only one of the channels. when I run lncli closedchannels, I get the printout below. From this, you can see that one channel appears as outcome "claimed" but the other two appear as "unclaimed". I'm not sure what needs to be done to "claim" them. Also, I'm a bit confused as to why all the channels appear as "close_initiator": "INITIATOR_REMOTE",. I expected them to be INITIATOR_LOCAL?

To recover these funds I have tried:
chantools sweepremoteclosed --recoverywindow 300 --sweepaddr tb1quljn5gcttuw6xekjg2dcp9ua2crezn8q2n46my --publish -t --apiurl https://blockstream.info/testnet/api/
This returned found 0 sweep targets with total value of 0 satoshis which is below the dust limit of 600

Any help would be greatly appreciated.

"channels": [
        {
            "channel_point": "2f98b94528221001586a82187f4a4ba8a4ec6508d55c8121a0e296d1806d3b05:1",
            "chan_id": "2789812843390304257",
            "chain_hash": "000000000933ea01ad0ee984209779baaec3ced90fa3f408719526f8d77f4943",
            "closing_tx_hash": "bdf8b180cb63c41389781a3c074ac33a968fbd3a80b845e99d4e1fc6f5f82698",
            "remote_pubkey": "03f060953bef5b777dc77e44afa3859d022fc1a77c55138deb232ad7255e869c00",
            "capacity": "65000",
            "close_height": 2538546,
            "settled_balance": "64056",
            "time_locked_balance": "0",
            "close_type": "REMOTE_FORCE_CLOSE",
            "open_initiator": "INITIATOR_LOCAL",
            "close_initiator": "INITIATOR_REMOTE",
            "resolutions": [
                {
                    "resolution_type": "ANCHOR",
                    "outcome": "UNCLAIMED",
                    "outpoint": {
                        "txid_bytes": "9826f8f5c61f4e9de945b8803abd8f963ac34a073c1a788913c463cb80b1f8bd",
                        "txid_str": "bdf8b180cb63c41389781a3c074ac33a968fbd3a80b845e99d4e1fc6f5f82698",
                        "output_index": 0
                    },
                    "amount_sat": "330",
                    "sweep_txid": ""
                },
                {
                    "resolution_type": "COMMIT",
                    "outcome": "UNCLAIMED",
                    "outpoint": {
                        "txid_bytes": "9826f8f5c61f4e9de945b8803abd8f963ac34a073c1a788913c463cb80b1f8bd",
                        "txid_str": "bdf8b180cb63c41389781a3c074ac33a968fbd3a80b845e99d4e1fc6f5f82698",
                        "output_index": 1
                    },
                    "amount_sat": "64056",
                    "sweep_txid": "06033bf78b6b385d6960d5db86b345641255b12f26c7007e25c8a50a75d8ca19"
                }
            ],
            "alias_scids": [],
            "zero_conf_confirmed_scid": "0"
        },
        {
            "channel_point": "68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0",
            "chan_id": "2789808445344776192",
            "chain_hash": "000000000933ea01ad0ee984209779baaec3ced90fa3f408719526f8d77f4943",
            "closing_tx_hash": "d6680ed2e96081c549c1675c5f92497922fc92ef76e2e86a50a8c8957206b701",
            "remote_pubkey": "02312627fdf07fbdd7e5ddb136611bdde9b00d26821d14d94891395452f67af248",
            "capacity": "50000",
            "close_height": 2538546,
            "settled_balance": "49056",
            "time_locked_balance": "0",
            "close_type": "REMOTE_FORCE_CLOSE",
            "open_initiator": "INITIATOR_LOCAL",
            "close_initiator": "INITIATOR_REMOTE",
            "resolutions": [
                {
                    "resolution_type": "ANCHOR",
                    "outcome": "UNCLAIMED",
                    "outpoint": {
                        "txid_bytes": "01b7067295c8a8506ae8e276ef92fc227949925f5c67c149c58160e9d20e68d6",
                        "txid_str": "d6680ed2e96081c549c1675c5f92497922fc92ef76e2e86a50a8c8957206b701",
                        "output_index": 0
                    },
                    "amount_sat": "330",
                    "sweep_txid": ""
                },
                {
                    "resolution_type": "COMMIT",
                    "outcome": "UNCLAIMED",
                    "outpoint": {
                        "txid_bytes": "01b7067295c8a8506ae8e276ef92fc227949925f5c67c149c58160e9d20e68d6",
                        "txid_str": "d6680ed2e96081c549c1675c5f92497922fc92ef76e2e86a50a8c8957206b701",
                        "output_index": 1
                    },
                    "amount_sat": "49056",
                    "sweep_txid": "06033bf78b6b385d6960d5db86b345641255b12f26c7007e25c8a50a75d8ca19"
                }
            ],
            "alias_scids": [],
            "zero_conf_confirmed_scid": "0"
        },
        {
            "channel_point": "47bd9f389ea299c8ca8602c87ec60a745b5c3be7e1edb7af6f279df5639ba709:0",
            "chan_id": "2789751270737641472",
            "chain_hash": "000000000933ea01ad0ee984209779baaec3ced90fa3f408719526f8d77f4943",
            "closing_tx_hash": "9f9123f0adb73cc08753259832ed838812a08b4700b8a49860345e1ae26985db",
            "remote_pubkey": "038863cf8ab91046230f561cd5b386cbff8309fa02e3f0c3ed161a3aeb64a643b9",
            "capacity": "60000",
            "close_height": 2538554,
            "settled_balance": "59056",
            "time_locked_balance": "0",
            "close_type": "REMOTE_FORCE_CLOSE",
            "open_initiator": "INITIATOR_LOCAL",
            "close_initiator": "INITIATOR_REMOTE",
            "resolutions": [
                {
                    "resolution_type": "ANCHOR",
                    "outcome": "CLAIMED",
                    "outpoint": {
                        "txid_bytes": "db8569e21a5e346098a4b800478ba0128883ed3298255387c03cb7adf023919f",
                        "txid_str": "9f9123f0adb73cc08753259832ed838812a08b4700b8a49860345e1ae26985db",
                        "output_index": 0
                    },
                    "amount_sat": "330",
                    "sweep_txid": "90b1eb07cb61ea29829a93eb5f2457d17b920c754d1ce16ac6de26ac1f98aeb2"
                },
                {
                    "resolution_type": "COMMIT",
                    "outcome": "CLAIMED",
                    "outpoint": {
                        "txid_bytes": "db8569e21a5e346098a4b800478ba0128883ed3298255387c03cb7adf023919f",
                        "txid_str": "9f9123f0adb73cc08753259832ed838812a08b4700b8a49860345e1ae26985db",
                        "output_index": 1
                    },
                    "amount_sat": "59056",
                    "sweep_txid": "90b1eb07cb61ea29829a93eb5f2457d17b920c754d1ce16ac6de26ac1f98aeb2"
                }
            ],
            "alias_scids": [],
            "zero_conf_confirmed_scid": "0"
        }
    ]

[tempo-beme]

Also have this in the logs from one of the unclaimed channel points (68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0)

2023-11-15 18:39:48 2023-11-15 07:39:48.845 [INF] PEER: Peer(02312627fdf07fbdd7e5ddb136611bdde9b00d26821d14d94891395452f67af248): Loading ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0), isPending=false
2023-11-15 18:39:48 2023-11-15 07:39:48.845 [WRN] PEER: Peer(02312627fdf07fbdd7e5ddb136611bdde9b00d26821d14d94891395452f67af248): Unable to find our forwarding policy for channel 68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0, using default values
2023-11-15 18:39:48 2023-11-15 07:39:48.848 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): starting
2023-11-15 18:39:48 2023-11-15 07:39:48.852 [INF] HSWC: Trimming open circuits for chan_id=2537316:41:0, start_htlc_id=0
2023-11-15 18:39:48 2023-11-15 07:39:48.855 [INF] HSWC: Adding live link chan_id=2ed652d90e1f84ab15a494d73f91291029a5f5049ed1f4a448f8aac0449b3268, short_chan_id=2537316:41:0
2023-11-15 18:39:48 2023-11-15 07:39:48.858 [INF] PEER: Peer(02312627fdf07fbdd7e5ddb136611bdde9b00d26821d14d94891395452f67af248): Negotiated chan series queries
2023-11-15 18:39:48 2023-11-15 07:39:48.855 [INF] CNCT: Attempting to update ContractSignals for ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0)
2023-11-15 18:39:48 2023-11-15 07:39:48.855 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): HTLC manager started, bandwidth=0 mSAT
2023-11-15 18:39:48 2023-11-15 07:39:48.858 [INF] NTFN: New block epoch subscription
2023-11-15 18:39:48 2023-11-15 07:39:48.861 [INF] DISC: Creating new GossipSyncer for peer=02312627fdf07fbdd7e5ddb136611bdde9b00d26821d14d94891395452f67af248
2023-11-15 18:39:48 2023-11-15 07:39:48.867 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): attempting to re-synchronize
2023-11-15 18:39:48 2023-11-15 07:39:48.875 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): received re-establishment message from remote side
2023-11-15 18:39:48 2023-11-15 07:39:48.877 [ERR] LNWL: ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): sync failed with local data loss: remote believes our tail height is 0, while we have 0!
2023-11-15 18:39:48 2023-11-15 07:39:48.878 [WRN] LNWL: ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): detected restored triggering DLP
2023-11-15 18:39:48 2023-11-15 07:39:48.880 [WRN] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): error when syncing channel states: ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0) with CommitPoint(02ab1793f0bdd0107839b0afc2876406c11b9d701b4379a714884411e136f43b12) had possible local commitment state data loss
2023-11-15 18:39:48 2023-11-15 07:39:48.886 [ERR] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): failing link: unable to synchronize channel states: ChannelPoint(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0) with CommitPoint(02ab1793f0bdd0107839b0afc2876406c11b9d701b4379a714884411e136f43b12) had possible local commitment state data loss with error: unable to resume channel, recovery required
2023-11-15 18:39:48 2023-11-15 07:39:48.886 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): exited
2023-11-15 18:39:48 2023-11-15 07:39:48.886 [INF] HSWC: ChannelLink(68329b44c0aaf848a4f4d19e04f5a5291029913fd794a415ab841f0ed952d62e:0): stopping

[hieblmi]

Hi @tempo-beme, it seems like that all channel closes settled on-chain and the settled balances have already been used to open new channels.

https://mempool.space/testnet/address/tb1q7hdw3f9mnfy36e7uhgnx375zm94ca9hfqvn2r6l5dh0kk4y7pczskakkxj
https://mempool.space/testnet/address/tb1qvdxx48gcn7pyhh79vnjm8hyr5lk4zk9vw0ahx7uzclc7fw8cce9ss472cv
https://mempool.space/testnet/address/tb1qvxj3xfwrnruuvw0c2ny9lm33wuxqmq6cmcjlzcpn59383nctczesaq3nwu

I'd say this is why you can't recover with chantools, the lncli closedchannels should show all outputs as claimed.

[tempo-beme]

Hi @hieblmi thanks for the response. Can you help me understand what has happened?

I don't understand how the settled balances have been used to open new channels? Has someone else managed to "claim" the funds?
From what I can tell, this tx
https://mempool.space/testnet/address/tb1pyre56gpd0hukd03z453xgd2yjtxj2sp8m34mpqdtuzuzzdzds4uqqkygad
has not been used to open other channels. This also shows up in my balance when I run lncli walletbalance

I can see from what you sent, the other two transactions seem to have gone to another address? i'm really lost as to why? this seems unrecoverable? Might I have done something wrong when I tried to recover from channel.backup?
also, why would lncli closedchannels not show the outputs as claimed?

[hieblmi]

Apologies, there weren't any new channels opened.

I think your node swept funds of two channel closures to one address, namely
https://mempool.space/testnet/address/tb1q7hdw3f9mnfy36e7uhgnx375zm94ca9hfqvn2r6l5dh0kk4y7pczskakkxj
and
https://mempool.space/testnet/address/tb1qvxj3xfwrnruuvw0c2ny9lm33wuxqmq6cmcjlzcpn59383nctczesaq3nwu
.
You should see those at one UTXO in lncli listunspent - tb1p4728n9wd2pa79stnjyypxg990g4lr7erh0wxjamecnmkulh8mhpsvk7crs

You should also see a second UTXO in your unspent outputs from the closing https://mempool.space/testnet/address/tb1qvdxx48gcn7pyhh79vnjm8hyr5lk4zk9vw0ahx7uzclc7fw8cce9ss472cv

[tempo-beme]

lncli listunspent gives only one UTXO

{
        "utxos": [
                {
                        "address_type": 4,
                        "address": "tb1pyre56gpd0hukd03z453xgd2yjtxj2sp8m34mpqdtuzuzzdzds4uqqkygad",
                        "amount_sat": 59191,
                        "pk_script": "512020f34d202d7df966be22ad2264354492cd254027dc6bb081abe0b821344d8578",
                        "outpoint": "90b1eb07cb61ea29829a93eb5f2457d17b920c754d1ce16ac6de26ac1f98aeb2:0",
                        "confirmations": 366
                }
        ]
}

I have tried resyncing the node with reset-wallet-transactions=true but this still doesn't show any other unspent utxos. Is there a way for my node to either sweep these utxos, or get them to show correctly?

[tempo-beme]

I have managed to fix this issue and thought I would write down what I did in case it helps others. Going through the logs, i found this message related to one of the missing transactions: broadcast failed because of: double spend: -25: bad-txns-inputs-missingorspent. I'm not sure why lnd thought this, but this is likely the reason it wasn't appearing correctly on my balance.

Things I tried:

• Nothing using chantools worked.
• I tried restarting lnd with --reset-wallet-transactions. This didn't work
• I tried following this discussion. publishtx displayed the transaction id but nothing else happened. Funds still didn't show.
• I read somewhere that these issues could be due to the bitcoin backend. My backend was showing the transaction correctly, so I suspected it wasn't this, but regardless, I was an older version of bitcoind (23.0). I upgraded to 25.1. Upgrading itself didn't make a difference, however, after upgrading, one of these next two things worked, but not sure which.
• After upgrading, I restarted my lnd node with --reset-wallet-transactions.
• tried broadcasting the missing transaction again using lncli wallet publishtx.

Now, my balance when running walletbalance appears correctly. listchaintxns also now shows the transactions correctly. However, closedchannels still shows the two transactions as "resolution_type": "ANCHOR", "outcome": "UNCLAIMED".

I was able to sweep all funds and send to another wallet. My best guess at what the issue was here is the version of my bitcoind backend. I'm not sure how or why this would have caused this issue but upgrading seemed to have worked.