[Mining Issue] winningPoST failed due to GenerateWinningPoSt timeout (RTX3090 compatible issue?) #5978
Replies: 7 comments 5 replies
-
2021-04-04T01:38:18.249 INFO storage_proofs_core::compound_proof > vanilla_proofs:finish Something wrong with GPU selection (about 43 seconds)? Please help. |
Beta Was this translation helpful? Give feedback.
-
Is your CPU busy at that time? Is there a reason why you set CPU to 0.875? One thing you could try is to comment out the BELLMAN_CPU_UTILIZATION, or set it to 0. |
Beta Was this translation helpful? Give feedback.
-
Thanks for the help. I commented out the BELLMAN_CPU_UTILIZATION but it didn't work:
|
Beta Was this translation helpful? Give feedback.
-
can you provide all the logs starting from "filcrypto::proofs::api > generate_winning_post: start"? also the logs for window post? Is window post using the GPU properly? |
Beta Was this translation helpful? Give feedback.
-
@narkissos any progress? |
Beta Was this translation helpful? Give feedback.
-
just SET HOME path. some daemon like supervisor has no HOME env var by default. set it and worked |
Beta Was this translation helpful? Give feedback.
-
@narkissos Were you able to resolve the problem? What was the solution? |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I have mined my first block and got failure message:
miner miner/miner.go:506 mined new block {"cid": "bafy2bzaceaspuauyptgsgwbi5riw3j76lddxk6hxk75miy4axccqa5dvihtng", "height": "637587", "miner": "f01...", "parents": ["f02...","f01...","f01...","f07...."], "took": 51.510231956}
2021-04-03T15:13:58.116+0800 WARN miner miner/miner.go:508 CAUTION: block production took longer than the block delay. Your computer may not be fast enough to keep up {"tMinerBaseInfo ": 0.006562593, "tDrand ": 0.00000016, "tPowercheck ": 0.00000015, "tTicket ": 0.003899526, "tSeed ": 0.000006931, "tProof ": 47.77455959, "tPending ": 0.155116721, "tCreateBlock ": 3.570086285}
Describe the problem
GenerateWinningPoSt took 47.77395527s to lose the winningPoST.
Version
Daemon: 1.7.0-dev+mainnet+git.f4a2c8fa4+api1.1.0
Local: lotus version 1.7.0-dev+mainnet+git.f4a2c8fa4
Setup
CPU: AMD EPYC 7402
MEM: 256g
GPU: NVidia RTX3090
Only running lotus node and miner node on this machine. No workers or other GPU consuming jobs on it.
Lotus daemon and miner logs
miner log:
2021-04-04T01:38:18.409 DEBUG bellperson::gpu::locks > GPU lock acquired!
2021-04-04T01:39:01.139 INFO bellperson::gpu::multiexp > Multiexp: 1 working device(s) selected. (CPU utilization: 0.875)
full log:
2021-04-04T01:38:18.249 INFO storage_proofs_core::compound_proof > vanilla_proofs:finish
2021-04-04T01:38:18.303 INFO storage_proofs_core::compound_proof > snark_proof:start
2021-04-04T01:38:18.303 INFO bellperson::groth16::prover > Bellperson 0.12.5 is being used!
2021-04-04T01:38:18.397 INFO bellperson::groth16::prover > starting proof timer
2021-04-04T01:38:18.404 DEBUG bellperson::gpu::locks > Acquiring priority lock at "/tmp/bellman.priority.lock" ...
2021-04-04T01:38:18.404 DEBUG bellperson::gpu::locks > Priority lock acquired!
2021-04-04T01:38:18.409 INFO bellperson::gpu::locks > GPU is available for FFT!
2021-04-04T01:38:18.409 DEBUG bellperson::gpu::locks > Acquiring GPU lock at "/tmp/bellman.gpu.lock" ...
2021-04-04T01:38:18.409 DEBUG bellperson::gpu::locks > GPU lock acquired!
2021-04-04T01:39:01.139 INFO bellperson::gpu::multiexp > Multiexp: 1 working device(s) selected. (CPU utilization: 0.875)
2021-04-04T01:39:01.139 INFO bellperson::gpu::multiexp > Multiexp: Device 0: GeForce RTX 3090 (Chunk-size: 18061702)
2021-04-04T01:39:01.139 INFO bellperson::multiexp > GPU Multiexp kernel instantiated!
2021-04-04T01:39:04.018 DEBUG bellperson::gpu::locks > GPU lock released!
2021-04-04T01:39:04.021 DEBUG bellperson::gpu::locks > Priority lock released!
2021-04-04T01:39:04.022 INFO bellperson::groth16::prover > prover time: 45.624253896s
2021-04-04T01:39:04.025 INFO storage_proofs_core::compound_proof > snark_proof:finish
2021-04-04T01:39:04.025 INFO filecoin_proofs::api::post > generate_winning_post:finish
2021-04-04T01:39:04.026 INFO filcrypto::proofs::api > generate_winning_post: finish
** Code modifications **
No code modifications.
Beta Was this translation helpful? Give feedback.
All reactions