Sectors stuck in TerminateWait (entered TerminateWait with nil TerminateMessage)

[Shekelme]

Hi all! I have 28 sectors stuck in TerminateWait state. There are some log entries during miner start related to these sectors:

 2022-01-27T19:24:21.726+0300    ERROR   sectors storage-sealing/fsm.go:28       unhandled sector error (5026): entered TerminateWait with nil TerminateMessage:
     github.com/filecoin-project/lotus/extern/storage-sealing.(*Sealing).handleTerminateWait
         /home/admfc/lotus/extern/storage-sealing/states_proving.go:81
 2022-01-27T19:24:21.910+0300    INFO    stores  stores/index.go:152     New sector storage: f0d0dba6-f48e-4132-a575-e9ad1e03a907
 2022-01-27T19:24:21.914+0300    INFO    node    impl/storminer.go:400   Connected to a remote worker at http://192.168.11.33:3456/rpc/v0
 2022-01-27T19:24:21.923+0300    ERROR   sectors storage-sealing/fsm.go:28       unhandled sector error (5301): entered TerminateWait with nil TerminateMessage:
     github.com/filecoin-project/lotus/extern/storage-sealing.(*Sealing).handleTerminateWait
         /home/admfc/lotus/extern/storage-sealing/states_proving.go:81
 2022-01-27T19:24:21.923+0300    ERROR   sectors storage-sealing/fsm.go:28       unhandled sector error (5302): entered TerminateWait with nil TerminateMessage:
     github.com/filecoin-project/lotus/extern/storage-sealing.(*Sealing).handleTerminateWait
         /home/admfc/lotus/extern/storage-sealing/states_proving.go:81

and so on. Sectors looks the same:

 lotus-miner sectors status --log 5026
 SectorID:       5026
 Status:         TerminateWait
 CIDcommD:       baga6ea4seaqomqafu276g53zko4k23xzh4h4uecjwicbmvhsuqi7o4bhthhm4aq
 CIDcommR:       bagboea4b5abcbpnltkgtzndhcvmjmvh7womyjh3ajobg57swsu2gnmrx2lfmbhra
 Ticket:         2fa71b5bc57fa8013328bc65c055b2d8ebfa221f5f7a78cca1f7597d4c7e0e26
 TicketH:        1194210
 Seed:           a3063d8536bf088cd4fd1c49a3843be78bf0d43266d0da94cf9696bedab7a097
 SeedH:          1195946
 Precommit:      bafy2bzacea3o33laku6eo5nkizzse6gaclnxgpk23qdcfsgio6vwdifkabghw
 Commit:         bafy2bzaceali3yc7lit6sruki4n5leqraqch7ndtb662i2w7c7cphdwhrz5hs
 Deals:          [0]
 Retries:        0
 --------
 Event Log:
 0.      2021-10-14 00:12:13 +0300 MSK:  [event;sealing.SectorStartCC]   {"User":{"ID":5026,"SectorType":9}}
 1.      2021-10-14 00:15:08 +0300 MSK:  [event;sealing.SectorPacked]    {"User":{"FillerPieces":[{"Size":68719476736,"PieceCID":{"/":"baga6ea4seaqomqafu276g53zko4k23xzh4h4uecjwicbmvhsuqi7o4bhthhm4aq"}}]}}
 2.      2021-10-14 00:15:08 +0300 MSK:  [event;sealing.SectorTicket]    {"User":{"TicketValue":"L6cbW8V/qAEzKLxlwFWy2Ov6Ih9fenjMofdZfUx+DiY=","TicketEpoch":1194210}}
 3.      2021-10-14 05:07:57 +0300 MSK:  [event;sealing.SectorPreCommit1]        {"User":{"PreCommit1Out":"eyJyZWdpc3RlcmVkX3Byb29mIjoiU3RhY2tlZERyZzY0R2lCVjFfMSIsImxhYmVscyI6eyJTdGFja2VkRHJnNjRHaUJWMSI6eyJsYWJlbHMiOlt7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci0xIiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci0yIiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci0zIiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci00Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci01Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci02Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci03Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci04Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci05Iiwic2l6ZSI6MjE0NzQ4MzY0OCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJsYXllci0xMCIsInNpemUiOjIxNDc0ODM2NDgsInJvd3NfdG9fZGlzY2FyZCI6N30seyJwYXRoIjoiL21lZGlhL3NuNzUwL3dvcmtlcjEvY2FjaGUvcy10MDEyMjI1OTUtNTAyNiIsImlkIjoibGF5ZXItMTEiLCJzaXplIjoyMTQ3NDgzNjQ4LCJyb3dzX3RvX2Rpc2NhcmQiOjd9XSwiX2giOm51bGx9fSwiY29uZmlnIjp7InBhdGgiOiIvbWVkaWEvc243NTAvd29ya2VyMS9jYWNoZS9zLXQwMTIyMjU5NS01MDI2IiwiaWQiOiJ0cmVlLWQiLCJzaXplIjo0Mjk0OTY3Mjk1LCJyb3dzX3RvX2Rpc2NhcmQiOjd9LCJjb21tX2QiOlsyMzAsNjQsNSwxNjYsMTkxLDIyNywxMTksMTIxLDgzLDE4NCwxNzMsMTEwLDI0OSw2MywxNSwyMDIsMTYsNzMsMTc4LDQsMjIsODQsMjQyLDE2NCwxNywyNDcsMTEyLDM5LDE1MywyMDYsMjA2LDJdfQ=="}}
 4.      2021-10-14 05:40:21 +0300 MSK:  [event;sealing.SectorPreCommit2]        {"User":{"Sealed":{"/":"bagboea4b5abcbpnltkgtzndhcvmjmvh7womyjh3ajobg57swsu2gnmrx2lfmbhra"},"Unsealed":{"/":"baga6ea4seaqomqafu276g53zko4k23xzh4h4uecjwicbmvhsuqi7o4bhthhm4aq"}}}
 5.      2021-10-14 05:40:21 +0300 MSK:  [event;sealing.SectorPreCommitBatch]    {"User":{}}
 6.      2021-10-14 05:57:27 +0300 MSK:  [event;sealing.SectorPreCommitBatchSent]        {"User":{"Message":{"/":"bafy2bzacea3o33laku6eo5nkizzse6gaclnxgpk23qdcfsgio6vwdifkabghw"}}}
 7.      2021-10-14 06:01:00 +0300 MSK:  [event;sealing.SectorPreCommitLanded]   {"User":{"TipSet":"AXGg5AIg7TRHraDuo7f+HE1gBL5+LcBPutrOzRI/IBUj6j/ha3gBcaDkAiA5iBYEoBT+w4GfDaRdBowAQxNMbZP8Xdh4uHRNfLZMqgFxoOQCIGhnti/gI4MiwIhetdFxpe20Gr0cfFX6q45Ecq0VuYRcAXGg5AIgSR0YHyMtikNrOcQW4fYDysnVa8iq8FhEHDOUMnO0jqI="}}
 8.      2021-10-14 07:16:00 +0300 MSK:  [event;sealing.SectorSeedReady] {"User":{"SeedValue":"owY9hTa/CIzU/RxJo4Q754vw1DJm0NqUz5aWvtq3oJc=","SeedEpoch":1195946}}
 9.      2021-10-14 07:52:16 +0300 MSK:  [event;sealing.SectorCommitted] {"User":{"Proof":"qlqcNL/9c/AqpAMCIJLe5bRe8MKEroddR7Sk0rIDLqFCDVuGa/uj9/Skx/oG4s/6owDw3fTPi0CBHRamBjGDDKzSxBwnekZHok1clMv+w5aG8YEheGZb0BQZw+HvhRv0ARvfvGp56jJNbyxA45mjulZRtSTKj4i5Mia+Y2hF1Cb+37uICGmEYGmfmNrwDuiwtiV9IDD5k8Is19+ueUPgsxOjbNpaaCpcUHS2iNZf7SvBAmPOJpnj88PDPXAaFd7MrihNsE5cuE9/wX2BVuIABiP+/xMmonnO+M0JbXMDqlvxNID5QZzxyZdHQxRu4lfJiiBY7TU1asanJ8cC+lzmBdR4cJTUxazewA7kVhu8bjsZRsE3tCq7V1Etjh6UPqLYBBiRJhdxDurur1tDbQzVfOfQNsQCkfq+dKxIiTjJLcaNxR6xMAfvB5J7IQrg2eBRtbgZpChoYIU0EZt2WLuONga4qEXhrdW7tJjeYgNnVGmP63uD7eDULAoVwgbrmu6stLoKQDopNJvDlBi2L3b0eOrR7rWLYHNbY5Gg9MzA/hd8clGwSRpYAszZ6pKX8ucEuCvHECa3wEYhjuDs4rp6UUe/9hLpjEf5JdKHzBfHISOGxLRsxg67PTSHpiBm5qOVEWDFujCjPn4vmOVFICAWqQDyR/zWS8hSsibuF8ns2gKqnZkuYmvOFkFR8ZIEiZsfrV+ua9Qf5HC8ey0boDPv4SxbxIdRl512jJDcoSwrsSaF1+QJYkpmTcA8uBrZ/GJtsmqJ9Eh6LVFdb6wxnkCuilds9UaPW8sSuMv77OcbXCqY2SfXTSW/UkwFzW2ZQMqBjzR2SiHkVlloaJehpulheUwy2sfoIeQryqjR0yGfZHdkutES98tS4veS1rA794xnD5NVZuEg97tQS5gDBQYU/SEXPva8ei+CP4jQr6jk6iyBsP1XVGTiGyc6F9J22HZSgGz6P/ZaZaCdgBx54SQlECJ7XI5VHzrP2V7poLcobNEHls0M6DtV+5EIm60505wPuUM6HqYFcfgJw/DvtED6c2amdYIlLqaQ/aojVyVjJOU784K5ld2BFUD7AvoRYgzBgRlN8IXCFmpD3/CkzlrmXHH8zo55td3B79n6a7yK0BQDZjtAPCjpvi8druGdZg7xE6ZBsEly5zgfliAb3EmZDEjxRD7j0wQL12fRxKJTILa+2rG7/ld71R5HrRSWMSOoshi2jmrEOsemacJv9JQf9KONZgDBDKr0TuxTTReHAfbCXSm7d6PQy2HOsKl/TMAfqZTbLbSxH7k1eePbc4Gi3BaIEjGSYLQrDUB1ISX0aatIFWn0qKmnS6GAo3awcJJtjBUR2m2png0aSBZ/JN3L9o+2qJNKOH6N4XH/+BEZDySauBRQqPejIWXAgtoRF2P5BrL5BFp1p+pqoR930Uh7KfSUuIm/KDNjclJOfVAwgX+qTDKBJ/1XnrJH0l1eLG9jo4aVQmGgZt1tPQXN/sAt7ZxJAZ/6VR97z55e5sOfu+FVR0yPFnKn5JHy6rOUDEDJuT4yAjCvLWFLA1oCnCasHpvCm18HqAA19+rHmjTIConE71pql6xPNcTnhOH7WQEQqXZ84Vua8fBO4ytwo4GvYfj3CQE3pIKZhqBCQw0FZpdiEfsUTncASLWVEEAtZ2ctCNiaxKE5ALtMt10n4Lq3wINA7Fpq5YJC8+hEDsmdoxj2yGL6q4MAWb0rzERXZwJcp3prav1OY2snCCrmmGjyufBHJOTWbz39frGO0dQuqR2I+YDgrPeourq/y+a4AJDBs10JbTgkpGpNdWOQPWhlFzSjq7+Nj5W5S0+jVnK3vcRtoV8ytPZTQJI/f/kmx+0PjJL+3DDrVS40csaVullcQ0mngL1kuzgl8ldgj+E08MV4Ngu9BaiN6UyNTPY6BW+0EogbQ/5RftVGbCoVUMICyZZw9UAaJgCSy+V9LUf66j/iysOVo09PrL8EqFTRdNCEgsu+QdS8NKzZxiLjC9LJlAof4OdbFa0M+R9lJ1LLVOKWbqkISe0nm//h501uClLRjnBUDtyQ6XmLuf5Ks3YBt8dn+RcJf0gd5Ygq9D7eWHRIt81p+7/jA2LYwi5PbROxiB7QtiGFjWsmPd2lPNtA96eW3NwEUdKJfwr4JaQ/8TFuAZ4Eyo1zQgcbA0xE15X7Fn+vxEDiok71d5z/EwZrraXYsrDfsmW/mHcJLzjfz5IO2RTvHOiYn5Z6R5sm+ST/k1m9mjftoejUlbM70pavSYHvxjNhoZav/YanxHB4xK8rlW4Cdy2YHyVS0Ie44P8JgmzGXfODywKIhohhhLPegI62+3ix2LtoNt99mrT/4O1XQDPiSrDn5iYlNyN/hJuJjN7SsU4NBP05BIBB/OubYx5eXJBIQoUOw1AHrOyzkhMxMcoaCH1bIUSUdbfcoQcvAWwJbjBdqXPFj63dWH3GXPQwsVfufScgyDjdinBTxZJHtEEvVZgSXhqLsLd5E9gEkfd913dOYz+Qnfd6P0HNjZUkzm0l7OgZLXE35f+5SM+zE105rowePHuEb3JNiYA6"}}
 10.     2021-10-14 07:52:16 +0300 MSK:  [event;sealing.SectorSubmitCommitAggregate]     {"User":{}}
 11.     2021-10-14 08:12:31 +0300 MSK:  [event;sealing.SectorCommitAggregateSent]       {"User":{"Message":{"/":"bafy2bzaceali3yc7lit6sruki4n5leqraqch7ndtb662i2w7c7cphdwhrz5hs"}}}
 12.     2021-10-14 08:16:00 +0300 MSK:  [event;sealing.SectorProving]   {"User":{}}
 13.     2021-10-14 08:25:55 +0300 MSK:  [event;sealing.SectorFinalized] {"User":{}}
 14.     2022-01-01 13:16:41 +0300 MSK:  [event;sealing.SectorRemove]    {"User":{}}
 15.     2022-01-01 13:16:43 +0300 MSK:  [event;sealing.SectorTerminate] {"User":{}}
 16.     2022-01-01 13:16:43 +0300 MSK:  [event;sealing.SectorRemoved]   {"User":{}}
 17.     2022-01-02 18:04:01 +0300 MSK:  [event;sealing.SectorTerminating]       {"User":{"Message":null}}

Is there any chance to terminate these sectors completely?

[LexLuthr]

@Shekelme Are you still facing this problem with v1.15.1? It has been fixed in the latest release.

[Shekelme]

I haven't updated the lotus yet.

[LexLuthr]

Please upgrade it and let us know if you still face this problem. We have some major fixes around terminating loop in the v1.15.1

[LexLuthr]

I am archiving this discussion as there has been no new input from the author for more than 7 days.

[SBudo]

Same issue just happened today on v1.15.2.
Error message:
2022-05-16T12:35:20.151+1000 ERROR sectors storage-sealing/fsm.go:34 unhandled sector error (1025): entered TerminateWait with nil TerminateMessage: github.com/filecoin-project/lotus/extern/storage-sealing.(*Sealing).handleTerminateWait

To give some additional information, it was an expired sectors with 4 deals (all expired a little over a day ago).
At the time of termination, the sector was "Proving: YES", "Active: NO"

Sector state info:

SectorNumber:  1025
SealProof:  8
SealedCID:  bagboea4b5abcapj35vlfr36huza53656c7kq36d5sov5yut5bncy55kgfs3qamdp
DealIDs:  [1934425 1934427 1934431 1934428]

Activation:  786396 (50 weeks 6 days ago)
Expiration:  1808512 (1 day 8 hours ago)

DealWeight:  0
VerifiedDealWeight:  469762048000000
InitialPledge:  0.265186764295191717 FIL
ExpectedDayReward:  0.002175050244881413 FIL
ExpectedStoragePledge:  0.040963355408357205 FIL

Deadline:  0
Partition:  0

Full sector status log:

SectorID:       1025
Status:         TerminateWait
CIDcommD:       baga6ea4seaqii3ravcgbsdlbtucdj3ktpllpwufgavwhqnaan2o52qfqqkfg6di
CIDcommR:       bagboea4b5abcapj35vlfr36huza53656c7kq36d5sov5yut5bncy55kgfs3qamdp
Ticket:         00bbacfd10b7e4b2b7abf0c4e9dd1adee47b487570e809a745083dc009b68e8a
TicketH:        784303
Seed:           e223cad4e9f16064fe9354f3d35251b8e6e41d7fe3a4cae9e34eb70dae341ef0
SeedH:          786303
Precommit:      bafy2bzacecfjcyja64no6naj4ngc2joucnxi2w74mt3gd4gfxqy7kbslfycm6
Commit:         bafy2bzacebd6g44vxbijj4kflvw57vgyiyawf4bctnkfwjgblddwem2xqgzqy
Deals:          [1934425 0 1934427 1934431 1934428 0 0 0 0 0 0]
Retries:        0
--------
Event Log:
0.      2021-05-24 17:18:30 +1000 AEST: [event;sealing.SectorStart]     {"User":{"ID":1025,"SectorType":8}}
1.      2021-05-24 17:18:30 +1000 AEST: [event;sealing.SectorAddPiece]  {"User":{}}
2.      2021-05-24 17:18:31 +1000 AEST: [event;sealing.SectorPieceAdded]        {"User":{"NewPieces":[{"Piece":{"Size":67108864,"PieceCID":{"/":"baga6ea4seaql4kkdhbxjemmsye5e2prcskyvlv23gffnuddbhxpqi67kepr6imi"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceabd6t54ckembeoxvvpfsyax5er6casq5r3x3zycvcvdedlotlxli"},"DealID":1934425,"DealProposal":{"PieceCID":{"/":"baga6ea4seaql4kkdhbxjemmsye5e2prcskyvlv23gffnuddbhxpqi67kepr6imi"},"PieceSize":67108864,"VerifiedDeal":true,"Client":"f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4tciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urbg36a","Provider":"f0773157","Label":"QmeR9jEd6AZscsyshPKoZLgSzuanxg9SdMHrz33MhDymzp","StartEpoch":804599,"EndEpoch":1804599,"StoragePricePerEpoch":"0","ProviderCollateral":"15810306223223","ClientCollateral":"0"},"DealSchedule":{"StartEpoch":804599,"EndEpoch":1804599},"KeepUnsealed":true}}]}}
3.      2021-05-24 17:18:31 +1000 AEST: [event;sealing.SectorAddPiece]  {"User":{}}
4.      2021-05-24 17:18:33 +1000 AEST: [event;sealing.SectorPieceAdded]        {"User":{"NewPieces":[{"Piece":{"Size":67108864,"PieceCID":{"/":"baga6ea4seaqnsqov4dldcsuzlqz77pkpxzurddlt2ts72lgtd4hxzbxl3ukoobq"}},"DealInfo":null},{"Piece":{"Size":134217728,"PieceCID":{"/":"baga6ea4seaqeqfcxjbjz4yiorrd2u3ndp36gkamvaigq5fg7n7aggkdiwdk54ay"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceabd6t54ckembeoxvvpfsyax5er6casq5r3x3zycvcvdedlotlxli"},"DealID":1934427,"DealProposal":{"PieceCID":{"/":"baga6ea4seaqeqfcxjbjz4yiorrd2u3ndp36gkamvaigq5fg7n7aggkdiwdk54ay"},"PieceSize":134217728,"VerifiedDeal":true,"Client":"f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4tciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urbg36a","Provider":"f0773157","Label":"QmWDNEuvUhA2RkZSQkivwntkKSWNwGwb8r71DUqywZaQ53","StartEpoch":804600,"EndEpoch":1804600,"StoragePricePerEpoch":"0","ProviderCollateral":"31620375568228","ClientCollateral":"0"},"DealSchedule":{"StartEpoch":804600,"EndEpoch":1804600},"KeepUnsealed":true}}]}}
5.      2021-05-24 17:18:33 +1000 AEST: [event;sealing.SectorAddPiece]  {"User":{}}
6.      2021-05-24 17:18:34 +1000 AEST: [event;sealing.SectorPieceAdded]        {"User":{"NewPieces":[{"Piece":{"Size":134217728,"PieceCID":{"/":"baga6ea4seaqeqfcxjbjz4yiorrd2u3ndp36gkamvaigq5fg7n7aggkdiwdk54ay"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceabd6t54ckembeoxvvpfsyax5er6casq5r3x3zycvcvdedlotlxli"},"DealID":1934431,"DealProposal":{"PieceCID":{"/":"baga6ea4seaqeqfcxjbjz4yiorrd2u3ndp36gkamvaigq5fg7n7aggkdiwdk54ay"},"PieceSize":134217728,"VerifiedDeal":true,"Client":"f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4tciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urbg36a","Provider":"f0773157","Label":"QmWDNEuvUhA2RkZSQkivwntkKSWNwGwb8r71DUqywZaQ53","StartEpoch":804610,"EndEpoch":1804610,"StoragePricePerEpoch":"0","ProviderCollateral":"31619744337240","ClientCollateral":"0"},"DealSchedule":{"StartEpoch":804610,"EndEpoch":1804610},"KeepUnsealed":true}}]}}
7.      2021-05-24 17:18:34 +1000 AEST: [event;sealing.SectorAddPiece]  {"User":{}}
8.      2021-05-24 17:18:35 +1000 AEST: [event;sealing.SectorPieceAdded]        {"User":{"NewPieces":[{"Piece":{"Size":134217728,"PieceCID":{"/":"baga6ea4seaqalafndqibtphsskiwowxjip7qdmm2yas6yxfke7kicgyu3leoabi"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceabd6t54ckembeoxvvpfsyax5er6casq5r3x3zycvcvdedlotlxli"},"DealID":1934428,"DealProposal":{"PieceCID":{"/":"baga6ea4seaqalafndqibtphsskiwowxjip7qdmm2yas6yxfke7kicgyu3leoabi"},"PieceSize":134217728,"VerifiedDeal":true,"Client":"f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4tciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urbg36a","Provider":"f0773157","Label":"QmdWBpbQnFhgWhWcEhDf7tV1f23QHtVx4NnYeVPzvF3U9p","StartEpoch":804601,"EndEpoch":1804601,"StoragePricePerEpoch":"0","ProviderCollateral":"31620386159440","ClientCollateral":"0"},"DealSchedule":{"StartEpoch":804601,"EndEpoch":1804601},"KeepUnsealed":true}}]}}
9.      2021-05-24 23:18:30 +1000 AEST: [event;sealing.SectorStartPacking]      {"User":{}}
10.     2021-05-24 23:21:41 +1000 AEST: [event;sealing.SectorPacked]    {"User":{"FillerPieces":[{"Size":536870912,"PieceCID":{"/":"baga6ea4seaqdsvqopmj2soyhujb72jza76t4wpq5fzifvm3ctz47iyytkewnubq"}},{"Size":1073741824,"PieceCID":{"/":"baga6ea4seaqmzq6acl23axubdiv37xipnaz3qqtvwr57ekoaauviescphqnfwpi"}},{"Size":2147483648,"PieceCID":{"/":"baga6ea4seaqh34u3nf3tdgpi6k2aw54rtucikcpo25uofrzjpmprinydj7b4mla"}},{"Size":4294967296,"PieceCID":{"/":"baga6ea4seaqgntqfunthkuwpixacxtcoqojjdg66vq254l7vmjyyjdu7pntvcby"}},{"Size":8589934592,"PieceCID":{"/":"baga6ea4seaqnqyicdbbfvnpjlmokmi45fgroiigxa2uw6nz6f6ojveoxlhizwai"}},{"Size":17179869184,"PieceCID":{"/":"baga6ea4seaqg2nsld34emra2ljfgrbrdcswmbjdpaftrpzjuipudt3w7qpbikpa"}}]}}
11.     2021-05-24 23:21:41 +1000 AEST: [event;sealing.SectorTicket]    {"User":{"TicketValue":"ALus/RC35LK3q/DE6d0a3uR7SHVw6AmnRQg9wAm2joo=","TicketEpoch":784303}}
12.     2021-05-25 04:20:04 +1000 AEST: [event;sealing.SectorPreCommit1]        {"User":{"PreCommit1Out":"eyJyZWdpc3RlcmVkX3Byb29mIjoiU3RhY2tlZERyZzMyR2lCVjFfMSIsImxhYmVscyI6eyJTdGFja2VkRHJnMzJHaUJWMSI6eyJsYWJlbHMiOlt7InBhdGgiOiIvbW50L252bWUxL3dvcmtlci9jYWNoZS9zLXQwNzczMTU3LTEwMjUiLCJpZCI6ImxheWVyLTEiLCJzaXplIjoxMDczNzQxODI0LCJyb3dzX3RvX2Rpc2NhcmQiOjd9LHsicGF0aCI6Ii9tbnQvbnZtZTEvd29ya2VyL2NhY2hlL3MtdDA3NzMxNTctMTAyNSIsImlkIjoibGF5ZXItMiIsInNpemUiOjEwNzM3NDE4MjQsInJvd3NfdG9fZGlzY2FyZCI6N30seyJwYXRoIjoiL21udC9udm1lMS93b3JrZXIvY2FjaGUvcy10MDc3MzE1Ny0xMDI1IiwiaWQiOiJsYXllci0zIiwic2l6ZSI6MTA3Mzc0MTgyNCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbW50L252bWUxL3dvcmtlci9jYWNoZS9zLXQwNzczMTU3LTEwMjUiLCJpZCI6ImxheWVyLTQiLCJzaXplIjoxMDczNzQxODI0LCJyb3dzX3RvX2Rpc2NhcmQiOjd9LHsicGF0aCI6Ii9tbnQvbnZtZTEvd29ya2VyL2NhY2hlL3MtdDA3NzMxNTctMTAyNSIsImlkIjoibGF5ZXItNSIsInNpemUiOjEwNzM3NDE4MjQsInJvd3NfdG9fZGlzY2FyZCI6N30seyJwYXRoIjoiL21udC9udm1lMS93b3JrZXIvY2FjaGUvcy10MDc3MzE1Ny0xMDI1IiwiaWQiOiJsYXllci02Iiwic2l6ZSI6MTA3Mzc0MTgyNCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbW50L252bWUxL3dvcmtlci9jYWNoZS9zLXQwNzczMTU3LTEwMjUiLCJpZCI6ImxheWVyLTciLCJzaXplIjoxMDczNzQxODI0LCJyb3dzX3RvX2Rpc2NhcmQiOjd9LHsicGF0aCI6Ii9tbnQvbnZtZTEvd29ya2VyL2NhY2hlL3MtdDA3NzMxNTctMTAyNSIsImlkIjoibGF5ZXItOCIsInNpemUiOjEwNzM3NDE4MjQsInJvd3NfdG9fZGlzY2FyZCI6N30seyJwYXRoIjoiL21udC9udm1lMS93b3JrZXIvY2FjaGUvcy10MDc3MzE1Ny0xMDI1IiwiaWQiOiJsYXllci05Iiwic2l6ZSI6MTA3Mzc0MTgyNCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbW50L252bWUxL3dvcmtlci9jYWNoZS9zLXQwNzczMTU3LTEwMjUiLCJpZCI6ImxheWVyLTEwIiwic2l6ZSI6MTA3Mzc0MTgyNCwicm93c190b19kaXNjYXJkIjo3fSx7InBhdGgiOiIvbW50L252bWUxL3dvcmtlci9jYWNoZS9zLXQwNzczMTU3LTEwMjUiLCJpZCI6ImxheWVyLTExIiwic2l6ZSI6MTA3Mzc0MTgyNCwicm93c190b19kaXNjYXJkIjo3fV0sIl9oIjpudWxsfX0sImNvbmZpZyI6eyJwYXRoIjoiL21udC9udm1lMS93b3JrZXIvY2FjaGUvcy10MDc3MzE1Ny0xMDI1IiwiaWQiOiJ0cmVlLWQiLCJzaXplIjoyMTQ3NDgzNjQ3LCJyb3dzX3RvX2Rpc2NhcmQiOjd9LCJjb21tX2QiOlsxMzIsMTEwLDMyLDE2OCwxNDAsMjUsMTMsOTcsMTU3LDQsNTIsMjM3LDgzLDEyMiwyMTQsMjUxLDgwLDE2Niw1LDEwOCwxMjAsNTIsMCwxMTAsMTU3LDIyMSw2NCwxNzYsMTMwLDEzOCwxMTEsMTNdfQ=="}}
13.     2021-05-25 04:56:05 +1000 AEST: [event;sealing.SectorPreCommit2]        {"User":{"Sealed":{"/":"bagboea4b5abcapj35vlfr36huza53656c7kq36d5sov5yut5bncy55kgfs3qamdp"},"Unsealed":{"/":"baga6ea4seaqii3ravcgbsdlbtucdj3ktpllpwufgavwhqnaan2o52qfqqkfg6di"}}}
14.     2021-05-25 04:56:11 +1000 AEST: [event;sealing.SectorPreCommitted]      {"User":{"Message":{"/":"bafy2bzacecfjcyja64no6naj4ngc2joucnxi2w74mt3gd4gfxqy7kbslfycm6"},"PreCommitDeposit":"45165952707786804","PreCommitInfo":{"SealProof":8,"SectorNumber":1025,"SealedCID":{"/":"bagboea4b5abcapj35vlfr36huza53656c7kq36d5sov5yut5bncy55kgfs3qamdp"},"SealRandEpoch":784303,"DealIDs":[1934425,1934427,1934431,1934428],"Expiration":1808512,"ReplaceCapacity":false,"ReplaceSectorDeadline":0,"ReplaceSectorPartition":0,"ReplaceSectorNumber":0}}}
15.     2021-05-25 07:19:30 +1000 AEST: [event;sealing.SectorPreCommitLanded]   {"User":{"TipSet":"AXGg5AIgxvjBbQCcNC65EBndxWfO6MVwg2+nwpdSOMDJtscnylwBcaDkAiAF4NtjpjGUqUlyNjVK6WZLOXCKDl/znaLEWIt0DXdifAFxoOQCILlCFwNpyUjTc0vNmOD3YjP5gdzRIef0TcK3FE6hisq6AXGg5AIgGnaSRarNzBVT+r1UUY0tq++q+RMbLB7pRVcUIjshjoQBcaDkAiCVoBhgYEcCixcoSrp447uyG9H8rFBnDoYJDumX6IJfYwFxoOQCIFyR4P3MfGGrEbuZwrk3+rCNn2DxqCUnGfyxCULegI1Y"}}
16.     2021-05-25 08:34:30 +1000 AEST: [event;sealing.SectorSeedReady] {"User":{"SeedValue":"4iPK1OnxYGT+k1Tz01JRuObkHX/jpMrp4063Da40HvA=","SeedEpoch":786303}}
17.     2021-05-25 09:17:35 +1000 AEST: [event;sealing.SectorCommitted] {"User":{"Proof":"iBmw9wnC8Y8Grv8wlgjIn6oRUsKX6D+wnwmeAoKq0KyG6E215nJbGe/UsBpl+fyTho2peGnyWNgzPQwLfrP+iY4QlNliwJEbAzH3/N5PVTq7FXeR42OwhOWJEs08gW32B69b8G/jUPGmPNEKotWlXJxZi8T6NJEf5MZSrwK274vi50abTOgPdKV7lJGM8QEzmJ8v5SZrnCkPTNs24b5O7FwHXo00TiJbz9GYRLUw0w0XiWX9UaLq8Pj68+O8yfRJtw54iZYytjr2X7kRHgjo/GPTll/0ryQW6yaWL71gTRX2rHKBP0lwFRWapncHCd3trYyGdat/vFSWw21FHmcCPV/HVqOLiLPZz9DQGtvV+iTX1ahf73ojhayE0QZxpKC8DZ8+fr9FXzEB51Q6mOJJrvmtCNPT0MRs4mNdJMPBE4N19TnikMhdGOwx4wANQ2kwouF5JYfgnu3Hu7Lge47Llo4FGVoO04VxhDJFU7jrCVyhzvOJJL5qcmnA/PGGVX2pgJ0h1ailrfWz7V2qBWqSrVDm4T8u4ED6Bvao3N3mz/BTPC6uF9nmrjgupPs4v/04lOZQDIwu7Ao+kx0CUKaDpdoBu/eFUIGsE5lTGb8SFH5cArFDSgAmeL+8Mq94gXmgC9mLwuEPnnmhG8upPtY+NjFzPHqCw1VjnN+ZQolOOW/HWCvKEsb0/phH+iZnXgacp4LCHOvRZVCkZ7xcNkssjDRS0GF4qEnYMqI0Ap88iTPvvWrViQ7DiBr2xe/2fF6UrddyZnuxeLFG0MYFDZm1xLYw8eB/7gpy1fON38g4Y7wi+eulp3wVkExAFxW8VKgfojgHsLDW4WdfBMlW0trljtW4CItpitah3s1ZBYvZ4AdnLvqtd91sGpsvCuN/F/56BF8wz+rbJUJKkVHzZ0q6RfZ2XV3MCgl2qUzdGpl1LFWkjKQ++8oAzIJVJyRJqfOFkFbA9xh55iTyv338w3s7CIm5dyuVJ5aV95qLLf6lXZi2OJaRAezkyHp04qks0gCUksbaTz1dKGtA39yw6z5mE11QgflH2RAeUYDBET6RG50lP2J4h62VUOh/lFjHT9kLprxY6zJn2kG5gZ+41MwnsluJtcaBBHAVVdUL0WAvyuDp2rfade3bjpQTXB4G2Uw+GVqellrWTNGOlc5d/3Aqps1l8qlotyrdTz54Cs4kGVclubuzQLOm4/1okfOMCU+do5gQ56zEUjI26byeWEu5vKLYhw8b4sACmdzq05BPJsOn7isZGwrz4APWAJaZNG7ulLxiAipxZvcuEHRIDCzTeB8xegJLUOgK5N0s3gzjmp2jVuQn/hCG6stlq0sBHdTui59f3hH/uc74Pu70ATcGGPJJecT9yzUb12kaasEz8zedAFrUT/7YB97ytBk/gOfkCoVuOAd2R0f6V+k0ARi0uNcwdz6wJzPbuw/toCF0fuaFOPIcjJCenygSYGAWMacIgr/NHghSzW69VoORy+F7GLRhNx7gcIW39ilJ+zW/PPVejLiCT/V3wL/xlcnmovtFo+XGu8NyCw3+bKV/WWgdHgrXFlFqZQXSQ/7UZ3b0DjOYJbeagtASxxia8INnqFCCinBpew3tEDDk7YjPKzUlB+hlcxMQAAj9AIjsWxRx/cGQtNwoKF4Hz8nawWqZiTUdBZvTMua3T5TqHnlNxqKm0u6EcDFt8SDv+mJSXRnQBUq9x1/acvTx9nquSppOTfO2qyBF0GKleRPRHoDdnwcgI6epb+VwUQgsssEVHQwzH6b1hguF6QUeKAiKTgL+ru1gi1qqeBNk+od7npZALYZjS9d3Lpi+z/q5MWVDjNJkvhtc77VlYm8uLXse9VGoO/p+iBD4uo+KEsYBvsX7IcksNBMItK1xU3DnFDlsjwwjlRvKyv07mxEZ/gfpAaWosxIhFzaWmKKuegE+2T5FomI23Nwb/GzloiZuhNp1Y/KE3Gs2jqeoD5W72ciyiK43OaX5rxgs0C1q/XTk4AUEaFjb7u+dIy+BKMU29g2JSAzbj9dnxJu5KXxPiqEJUGcKhTnDoVGaAtuSjS8bmlFoypZi274bpxOuxIc6RDCYb5kVnbtJFRlElkjweAnSemvvBX99kqpy4VUnp4Ed7sdSfHTpJJ1xypDVkabCQbimU1GsysdGYsTJ1G/L3QN73BZh43FEEzvflO7MEv4Dif6PGHfcJmT8lE3mHN3PY0sQvGYcUQD7ve+3d+e2GMs9WORF1pFxk990OJI/sJ5pgnz5J0pe0in2a9mbq6TGzM/GI3Ue2Eumrtotybw6j84T6coUn4ActWZ66SI2DVrib/uyd28ZQUrbE6CMS6Czj3eeStAwEc/utoAeGIgWPD4qoRCQqUUQpg7XaCQZ4r2djO8igQD+ueTiUejTw/Pqz8/joiHzHXKCSDgZWiT4suLRloL81YEiGcroy3rkiqtuWr7kfq1QzI6Uy5Skxzt5bYUmI1RjSbIFCL79VKdaWRzY/0yg0uinq/UAC8Gpxo8u2UxKr+hKNd+zU3BoGAhAjWqLZyOAXx65AUyliwTfPXwpJbwDPhHH"}}
18.     2021-05-25 09:17:41 +1000 AEST: [event;sealing.SectorCommitSubmitted]   {"User":{"Message":{"/":"bafy2bzacebd6g44vxbijj4kflvw57vgyiyawf4bctnkfwjgblddwem2xqgzqy"}}}
19.     2021-05-25 09:21:00 +1000 AEST: [event;sealing.SectorProving]   {"User":{}}
20.     2021-05-25 10:05:05 +1000 AEST: [event;sealing.SectorFinalized] {"User":{}}
21.     2022-05-16 12:35:20 +1000 AEST: [event;sealing.SectorTerminate] {"User":{}}
22.     2022-05-16 12:35:20 +1000 AEST: [event;sealing.SectorTerminating]       {"User":{"Message":null}}

[SBudo]

Just tried to terminate another expired sector (this time no deals, just a CC) and same problem

[LexLuthr]

@SBudo I think we figure this out in the slack that you were trying to terminate the expired sectors. Thus, the missing terminate message as expired sectors have a dedicated command to remove them. Let me know if you need anything else on this discussion or if we are good to archive it.

[LexLuthr]

I am archiving this discussion as there has been no new input from the author for more than 7 days.