AssertionDefect in ForkedChain - candidate BlockRef is nil in updateFinalized #3777
Description
I've seen this error pop up on my local Hoodi node a few times just recently:
INF 2025-10-21 08:22:12.477+08:00 Launching execution client version=v0.2.1-fe162f00 config="(configFile: none(InputFile), dataDirFlag: none(OutDir), era1DirFlag: none(OutDir), eraDirFlag: none(OutDir), keyStoreDirFlag: none(OutDir), importKey: , trustedSetupFile: none(string), extraData: nimbus-eth1/v0.2.1-fe162f00, gasLimit: 60000000, network: [hoodi], customNetwork: none(NetworkParams), networkId: 560048, networkParams: (config: ..., genesis: (nonce: 0x0000000000001234, timestamp: 1742212800, extraData: [], gasLimit: 36000000, difficulty: 1, mixHash: 0x0000000000000000000000000000000000000000000000000000000000000000, coinbase: 0x0000000000000000000000000000000000000000, alloc: 335, number: 0, gasUser: 0, parentHash: 0x0000000000000000000000000000000000000000000000000000000000000000, baseFeePerGas: none(), blobGasUsed: -1, excessBlobGas: -1, parentBeaconBlockRoot: none())), logLevel: INFO, logStdout: auto, metricsEnabled: false, metricsPort: 9093, metricsAddress: 127.0.0.1, bootstrapNodes: [], bootstrapFile: , staticPeers: [], staticPeersFile: , reconnectMaxRetry: 0, reconnectInterval: 15, listenAddress: ::, tcpPort: 30303, udpPort: 30303, maxPeers: 25, nat: (hasExtIp: false, nat: NatAny), discovery: [V4, V5], netKey: random, agentString: nimbus-eth1/v0.2.1-fe162f00/linux-amd64/Nim-2.2.4, numThreads: 0, persistBatchSize: 4, dynamicBatchSize: true, rocksdbMaxOpenFiles: 2048, rocksdbWriteBufferSize: 67108864, rocksdbRowCacheSize: 0, rocksdbBlockCacheSize: 2147483648, rdbVtxCacheSize: 536870912, rdbKeyCacheSize: 1342177280, rdbBranchCacheSize: 1073741824, rdbPrintStats: false, rewriteDatadirId: false, eagerStateRootCheck: false, deserializeFcState: true, statelessProviderEnabled: false, statelessWitnessValidation: false, cmd: noCommand, httpPort: 8545, httpAddress: 127.0.0.1, rpcEnabled: false, rpcApi: [], wsEnabled: false, wsApi: [], historyExpiry: false, historyExpiryLimit: none(BlockNumber), portalUrl: , engineApiEnabled: true, engineApiPort: 8551, engineApiAddress: 127.0.0.1, engineApiWsEnabled: false, allowedOrigins: [], jwtSecret: none(InputFile), beaconSyncTarget: none(string), beaconSyncTargetIsFinal: false)"
INF 2025-10-21 08:22:12.478+08:00 Taskpool started numThreads=14
INF 2025-10-21 08:22:12.739+08:00 Database initialized base="(0x792b2b81e6a6961325a8436296a958856b01787c590d31b84091d63944a715cc, 1454145)" finalized="(0xddb1ffd55e5f701e1c4f8717e4eab877ae020a412909c9035310e25c585f50a7, 1454123)" head="(0x792b2b81e6a6961325a8436296a958856b01787c590d31b84091d63944a715cc, 1454145)"
INF 2025-10-21 08:22:12.831+08:00 Loading block DAG from database topics="forked chain" base=1454145 pendingFCU=e72ada452459 resolvedFin=1454214 canonicalHead=1454304 safe=1454244 numBlocks=162 heads=[1454304,1454224,1454268]
INF 2025-10-21 08:22:12.831+08:00 Please wait until DAG finish loading... topics="forked chain"
WRN 2025-10-21 08:22:43.877+08:00 UPnP/NAT-PMP not available topics="eth net nat"
INF 2025-10-21 08:22:43.879+08:00 Discovery ENR initialized topics="eth p2p discv5" enrAutoUpdate=true seqNum=1 ip=ok(::) tcpPort=ok(30303) udpPort=ok(30303) localEnrFields=[] uri=enr:-Ji4QBeXnB0NLK3tDpt8FxHWCZATfSGwaJSsWCIXZqqojl07Q2bwGxCxn7aoZuxHsx2plfXOPs-WDOpP1rmoozcSFf4BgmlkgnY0g2lwNpAAAAAAAAAAAAAAAAAAAAAAiXNlY3AyNTZrMaEDbgArqtMJJ_5BCdg2prB2ado2b1RdwAvD7Xu3iqb-_8ODdGNwgnZfg3VkcIJ2Xw
INF 2025-10-21 08:22:43.879+08:00 RLPx listener up topics="p2p" self=enode://6e002baad30927fe4109d836a6b07669da366f545dc00bc3ed7bb78aa6feffc3cd172f1de6ea921267d52238f3d9329811b805dd4527304b0d39d40f778bd163@[::]:30303
INF 2025-10-21 08:22:43.879+08:00 Starting discovery node topics="p2p" node=Node[:::30303] bindAddress=:::30303:30303 discV4=true discV5=true
INF 2025-10-21 08:22:43.880+08:00 JWT secret loaded topics="Jwt/HS256 auth" jwtSecretPath=/home/user/.local/state/nimbus/hoodi/jwt.hex
INF 2025-10-21 08:22:43.880+08:00 Engine API enabled url=http://127.0.0.1:8551
INF 2025-10-21 08:24:16.883+08:00 New payload received and validated topics="beacon engine" number=1454305 hash=8ea1fdb41a3a parent=f8c309ae2cb7 txs=45 gasUsed=57564576 blobGas=262144
WRN 2025-10-21 08:25:37.470+08:00 Forkchoice requested unknown head topics="beacon engine" hash=7f2aec7edca8
WRN 2025-10-21 08:25:53.736+08:00 Forkchoice requested unknown head topics="beacon engine" hash=f84096688b5e
INF 2025-10-21 08:26:12.904+08:00 Forkchoice requested sync to new head topics="beacon engine" number=1456739 hash=f77b6414e9eb base=1454145 finHash=eda0c4a5580c safe=44ae3a50c163 pendingFCU=eda0c4a5580c resolvedFin=1454275
INF 2025-10-21 08:26:12.905+08:00 Activating syncer topics="beacon sync" base=#1454145 head=#1454305 target=#1456739 targetHash=f77b6414e9eb nSyncPeers=2
INF 2025-10-21 08:26:14.738+08:00 Headers stashed topics="beacon sync" nStashed=800 nUnpoc=1793 nStagedQ=1 base=#1454145 head=#1454305 target=#1456739 throughput=298.8Kps/498.1K:1 nSyncPeers=2
INF 2025-10-21 08:26:15.748+08:00 Headers stashed (from queue) topics="beacon sync" nStashed=1600 nUnpoc=193 nStagedQ=0 base=#1454145 head=#1454305 target=#1456739 nSyncPeers=2
INF 2025-10-21 08:26:15.766+08:00 Headers stashed (from queue) topics="beacon sync" nStashed=33 nUnpoc=n/a nStagedQ=0 base=#1454145 head=#1454305 target=#1456739 nSyncPeers=2
INF 2025-10-21 08:26:16.901+08:00 State change, waiting for sync topics="beacon sync" prevState=headers newState=headersFinish nSyncPeers=2
INF 2025-10-21 08:26:17.755+08:00 State changed topics="beacon sync" prevState=headersFinish newState=blocks base=#1454145 head=#1454305 target=#1456739 targetHash=f77b6414e9eb
INF 2025-10-21 08:26:19.683+08:00 Forkchoice requested sync to new head topics="beacon engine" number=1456740 hash=7fdcb4708602 base=1454145 finHash=44ae3a50c163 safe=e6af99890e78 pendingFCU=44ae3a50c163 resolvedFin=1454398
INF 2025-10-21 08:26:21.570+08:00 Blocks DAG written to database topics="forked chain" base=1454145 baseHash=792b2b81e6a6 latest=0 latestHash=72f14e589504 head=1454304 headHash=f8c309ae2cb7 finalized=1454398 finalizedHash=44ae3a50c163 blocksSerialized=73 heads=[]
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(600) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(40) _ZN11importBlock59asyncHandler
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(677) _ZN12forked_chain11importBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EEN6blocks5BlockE
_ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE(382) _ZN11importBlock11importBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(702) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(469) _ZN12forked_chain13validateBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EEN6blocks5BlockE4bool
_ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE(382) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(545) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(224) _ZN12forked_chain15updateFinalizedE3refIN10chain_desc30ForkedChainRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(296) _ZN12forked_chain15updateFinalizedE3refIN10chain_desc30ForkedChainRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(41) _ZN10assertions16failedAssertImplE6string
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(36) _ZN10assertions11raiseAssertE6string
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(53) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(349) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(62) /home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(600) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(40) _ZN11importBlock59asyncHandler
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(677) _ZN12forked_chain11importBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EEN6blocks5BlockE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(702) _ZN11importBlock11importBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(469) _ZN12forked_chain13validateBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EEN6blocks5BlockE4bool
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(468) _ZN13validateBlock13validateBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(600) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(40) _ZN11importBlock59asyncHandler
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(677) _ZN12forked_chain11importBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EEN6blocks5BlockE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(702) _ZN11importBlock11importBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(469) _ZN12forked_chain13validateBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EE3refIN12chain_branch24BlockRefcolonObjectType_EEN6blocks5BlockE4bool
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(469) _ZN13validateBlock13validateBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(600) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(40) _ZN11importBlock59asyncHandler
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(677) _ZN12forked_chain11importBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EEN6blocks5BlockE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(678) _ZN11importBlock11importBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(600) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/sync/beacon/worker/blocks/blocks_import.nim(40) _ZN11importBlock59asyncHandler
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(677) _ZN12forked_chain11importBlockE3refIN10chain_desc30ForkedChainRefcolonObjectType_EEN6blocks5BlockE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(679) _ZN11importBlock11importBlockE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(584) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
[[reraised from:
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(369) nimbus_execution_client
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(366) _ZN23nimbus_execution_client4mainEN6config10NimbusConfE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/nimbus_execution_client.nim(319) _ZN23nimbus_execution_client19runExeClient_sfalseEN6config10NimbusConfE3refIN6common25CommonRefcolonObjectType_EE20InternalRaisesFutureI4void5tupleIN7futures14CancelledErrorEEE3refIN11nimbus_desc26NimbusNodecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncengine.nim(150) _ZN11asyncengine4pollE
/home/user/development/status-im/nimbus-eth1/vendor/nim-chronos/chronos/internal/asyncfutures.nim(382) _ZN12asyncfutures14futureContinueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(585) _ZN12processQueue12processQueueE3refIN7futures26FutureBasecolonObjectType_EE
/home/user/development/status-im/nimbus-eth1/vendor/nimbus-build-system/vendor/Nim/lib/system/stacktraces.nim(62) _ZN11stacktraces30auxWriteStackTraceWithOverrideE3varI3seqIN6system15StackTraceEntryEEE
]]
Error: unhandled exception: /home/user/development/status-im/nimbus-eth1/execution_chain/core/chain/forked_chain.nim(295, 13) `candidate.isNil.not` [AssertionDefect]