“ lotus-miner backup ...." sector loss！ #9477
Replies: 15 comments 15 replies
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
I think you missed step 3: If you didnt back up the Moving this to discussions since its not an issue. |
Beta Was this translation helpful? Give feedback.
-
|
Please see the post。 |
Beta Was this translation helpful? Give feedback.
-
|
I have seen the post - did you backup the |
Beta Was this translation helpful? Give feedback.
-
The "storage.json" backup is good. I tried to encapsulate one, but still couldn't submit it. Is it a problem with the graphics card driver?
|
Beta Was this translation helpful? Give feedback.
-
|
My video card doesn't seem to be working？
|
Beta Was this translation helpful? Give feedback.
-
|
setp3，This is done, but I forgot to describe it.在 2022年10月13日，06:36，Nicklas ***@***.***> 写道：
Hi @ChaiWenyu1983
I think you missed step 3:
Copy config.toml and storage.json into ~/.lotusminer:
https://lotus.filecoin.io/storage-providers/operate/backup-and-restore/#restore
If you didnt back up the storage.json you will have to add the path manually and restart the miner - so it can accesses the files again.
Moving this to discussions since its not an issue.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
Error log in executing "lotus-miner proving compute window-post [0]":
2022-10-13T07:24:47.967+0800 INFO wdpost wdpost/wdpost_run.go:403 computing window post {"batch": 0, "elapsed": 648.663849163, "skip": 0, "err": null}
2022-10-13T07:24:47.984+0800 ERROR wdpost wdpost/wdpost_run.go:450 generated incorrect window post proof {"post": [{"PoStProof":8,"ProofBytes":"jNO/apmi4blAyGa+vgMGBI+NJ7ju2ojhjtkluPpbcW285DRe2Z6THC4I8doSxjFEpNd22vMmNRcDnDlu51TNzHTg7q08KExwkg/vZ+/HLa7ZXtIJWlWrIF7HrjmTedPSBxanv84mTmTswYx3yx55eIBjw+66dv7hi6PRxUwRCFEZEQRlgjEzWSn0DfKPjm5jlW87Ac50zdKs/pVlLrK7p9ngWPWVsHrPcSCuy3qgOXGt9BJdn6PZtCkmcPj4WluO"}], "error": null}
Is there something wrong with my video card driver，Does the following figure prove that the drive is good?
|
Beta Was this translation helpful? Give feedback.
-
|
2022-10-13T13:52:14.189+0800 ERROR wdpost wdpost/wdpost_run.go:450 generated incorrect window post proof {"post": [{"PoStProof":8,"ProofBytes":"iC2w7+KsyhkEEmivJ64uAQmcvZw0uTht15FS7ZCL/jv1K7I1Cln3fhsu6u3fgOQKph/QXJAMXWfnjIUnpnZ7aS8ZF8HLNWLJDxAAOA/MIk0KfcOkqYGWdHE29Ih7K2UyCiLU14a3Wlg2p0bU/CeWSVJNLKSYjIS4NwT9bJkuXWDrsICDuiGXveTf5MwIEXYXsOo8gWq8f9MhTU9UKi6oZvPFA/ZQsKlp8KQ7nvB+AXusClXbKnse6fK1J2++iMBI"}], "error": null}
|
Beta Was this translation helpful? Give feedback.
-
|
Lets see. Your GPU seems fine, at least from the output of Troubleshooting steps:
Do you have any workers, PoSt workers? Just asking, if the miner is doing C2 then windowPost will fail because the GPU is busy. |
Beta Was this translation helpful? Give feedback.
-
|
Please see the post。 |
Beta Was this translation helpful? Give feedback.
-
|
There are no workers, only one machine, and the operating system is normal before failure.
|
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
Seems like some of the sector went bad after the restore. |
Beta Was this translation helpful? Give feedback.
-
|
After the recovery, only one sector was created and this could not be submitted.
|
Beta Was this translation helpful? Give feedback.
-
|
I recovered it from the "lotus miner" backup file from two weeks ago, and the sector file was up to the day before yesterday. I don't know if it has anything to do with this.
The reason for this is that the ubuntu automatic upgrade destroys the operating system, which should be a video card driver conflict and the system cannot be started. I had to redo the system.
|
Beta Was this translation helpful? Give feedback.
-
|
Well, if its a hardware issue, ubuntu or driver issue you need to test that. With information given, it hard to find the cause of why the sectors broke. If its below 10 bad sectors: |
Beta Was this translation helpful? Give feedback.
-
|
The following questions：
1. In the past two days, windowpost was not sealed. Today, only one is sealed because it has not been able to windowpost.
2.What command can I use to know which sectors are bad and delete it?
thanks！
|
Beta Was this translation helpful? Give feedback.
-
|
First,
Remove the sector locally:
Remove the sector onChain:
If you have any issues removing the faulty sectors, you can read how to do it here: |
Beta Was this translation helpful? Give feedback.
-
|
About 70.
|
Beta Was this translation helpful? Give feedback.
-
|
It looks like this after executing "lotus-miner sectors remove --really-do-it" and "lotus-miner sectors terminate --really-do-it" commands， what happens is waiting?
Execute "lotus miner producing check -- slow -- only bad 0" again. The lotus miner log has an error: |
Beta Was this translation helpful? Give feedback.
-
|
Unfortunately, the deletion of more than 70 bad sectors ("lotus miner sectors remove -- really do it" and "lotus miner sectors terminate -- really do it") does not work. It is still an error. 2022-10-14T13:25:06.429+0800 ERROR wdpost wdpost/wdpost_run.go:450 generated incorrect window post proof {"post": [{"PoStProof":8,"ProofBytes":"rvNAyWUyAKjgBo8tu5B6QwQptxmOAR/nVD6VBWUpErdQBT0Hl4qlr2cUlPqtUVlAoq0hguncDIP5ndZTeGH8tHEEhPMh3O18t5LVdfUSJ6DOGxIgQ7GcL4/we0X5abzgGXbWFsu6C8Qku1XY+1OfjOWr3nlXI7PkfN6KusEwOG/Uqq/1abg49Mtspz1VlZnlq1SsJgkk9/qWZ1kzW/nZJ2bYhUG1lz/PgRasWnZYPnkeYFO6ozTaV84UQeX63rEB"}], "error": null} |
Beta Was this translation helpful? Give feedback.
-
|
After the lotus miner restarts, there are a lot of errors and warnings. 2022-10-14T15:46:16.784+0800 ERROR advmgr [email protected]/sugar.go:208 Ignored key without a value. {"ignored": "commr is nil", "ignoredVerbose": "commr is nil:\n github.com/filecoin-project/lotus/node/impl.(*StorageMinerAPI).CheckProvable.func1\n /home/chaiwenyu/lotus/node/impl/storminer.go:1307"} |
Beta Was this translation helpful? Give feedback.
-
|
Can't anyone help with it? Is there no solution for such a serious problem?
|
Beta Was this translation helpful? Give feedback.
-
|
备份时间太久了，在封存的节点至少要每天备份的，正在封存的还未上链的sector不在备份文件中，从备份恢复没有这些sector的信息，这些sector没救了。还有一些应该是做完C2上链了，但 FIN 没做，索引没了，找不到数据。 |
Beta Was this translation helpful? Give feedback.
-
|
不容易啊，好亲切的汉字回复！备份是不包含这些扇区的，我是系统自动升级应该是和驱动冲突系统直接启动不起来，所以没有及时备份，没办法只能格机重装，用两周前的备份恢复。 |
Beta Was this translation helpful? Give feedback.
-
|
Did you seal these 70 sectors in the last 2 weeks @ChaiWenyu1983? Or to put it another way, would the sectors that are now marked as faulted have been included in your 2-week-old backup? |
Beta Was this translation helpful? Give feedback.
-
|
These 70 bad sectors are basically not included in the backup. |
Beta Was this translation helpful? Give feedback.
-
|
If the backup was 2 weeks old that would indeed be the case @ChaiWenyu1983. You need to make sure that you back up regularly to make sure that all sector sealing history is up to date. I personally run a backup every hour. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Checklist
Latest release, or the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.Lotus component
Lotus Version
Describe the Bug
The operating system fails, making it inaccessible. The redo system uses the backup file (louts-miner_backup. cbor) from two weeks ago. After the restore, the "lotus miner sectors list" displays a sector loss, but the file is still there.
All sectors are in "RecoveryTimeout" status, and filscan is in "window post" status The io displays "Recoveries" for a while but fails. Finally, all "Faults" are displayed.
Logging Information
Repo Steps
...
Beta Was this translation helpful? Give feedback.
All reactions