Synchronization is too slow

[vae520283995]

Checklist

• This is not a security-related bug/issue. If it is, please follow please follow the security policy.
• This is not a question or a support request. If you have any lotus related questions, please ask in the lotus forum.
• This is not a new feature request. If it is, please file a feature request instead.
• This is not an enhancement request. If it is, please file a improvement suggestion instead.
• I have searched on the issue tracker and the lotus forum, and there is no existing related issue or discussion.
• I am running the Latest release, or the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
• I did not make any code changes to lotus.

Lotus component

lotus daemon - chain sync

Lotus Version

"Version":"1.11.0+mainnet+git.283793f","APIVersion":66304,"BlockDelay":30

Describe the Bug

When the synchronization is completed, the node will fall behind after a period of time. I have to restart. After the restart, the synchronization can be completed again, but after a period of time, the node will fall behind.
The server configuration is 8 core cpu, 32G memory, 1TSSD

Logging Information

2021-07-23T06:42:39.440Z	INFO	chain	chain/sync.go:700	block validation	{"took": 68.004005789, "height": "957075", "age": 3909.440961094}
2021-07-23T06:42:39.464Z	INFO	chain	chain/sync.go:700	block validation	{"took": 69.701733769, "height": "957075", "age": 3909.464183732}
2021-07-23T06:42:51.738Z	WARN	vm	vm/runtime.go:149	VM.Call failure: not enough gas: used=32552279, available=58368281, use=34721049 (RetCode=7):
    github.com/filecoin-project/lotus/chain/vm.(*Runtime).chargeGasInternal
        /go/lotus/chain/vm/runtime.go:593
2021-07-23T06:42:51.738Z	WARN	vm	vm/runtime.go:394	vmctx send failed: to: f04, method: 8: ret: [], err: not enough gas: used=32552279, available=58368281, use=34721049 (RetCode=7)
2021-07-23T06:42:51.738Z	WARN	vm	vm/runtime.go:350	Abortf: failed to submit proof for bulk verification
2021-07-23T06:42:51.738Z	WARN	vm	vm/runtime.go:149	VM.Call failure: failed to submit proof for bulk verification (RetCode=7):
    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess
        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64
2021-07-23T06:42:51.738Z	WARN	vm	vm/vm.go:536	Send actor error	{"from": "f17rzo32p4ehnwamh2vdw3l6eunp77pbf7tyzliza", "to": "f01106668", "nonce": 78623, "method": "7", "height": "957075", "error": "failed to submit proof for bulk verification (RetCode=7):\n    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess\n        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64"}
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:149	VM.Call failure: not enough gas: used=32615979, available=61771031, use=34721049 (RetCode=7):
    github.com/filecoin-project/lotus/chain/vm.(*Runtime).chargeGasInternal
        /go/lotus/chain/vm/runtime.go:593
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:394	vmctx send failed: to: f04, method: 8: ret: [], err: not enough gas: used=32615979, available=61771031, use=34721049 (RetCode=7)
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:350	Abortf: failed to submit proof for bulk verification
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:149	VM.Call failure: failed to submit proof for bulk verification (RetCode=7):
    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess
        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64
2021-07-23T06:42:51.878Z	WARN	vm	vm/vm.go:536	Send actor error	{"from": "f17rzo32p4ehnwamh2vdw3l6eunp77pbf7tyzliza", "to": "f01106668", "nonce": 78624, "method": "7", "height": "957075", "error": "failed to submit proof for bulk verification (RetCode=7):\n    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess\n        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64"}
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:149	VM.Call failure: not enough gas: used=32615979, available=65173781, use=34721049 (RetCode=7):
    github.com/filecoin-project/lotus/chain/vm.(*Runtime).chargeGasInternal
        /go/lotus/chain/vm/runtime.go:593
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:394	vmctx send failed: to: f04, method: 8: ret: [], err: not enough gas: used=32615979, available=65173781, use=34721049 (RetCode=7)
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:350	Abortf: failed to submit proof for bulk verification
2021-07-23T06:42:51.878Z	WARN	vm	vm/runtime.go:149	VM.Call failure: failed to submit proof for bulk verification (RetCode=7):
    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess
        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64
2021-07-23T06:42:51.879Z	WARN	vm	vm/vm.go:536	Send actor error	{"from": "f17rzo32p4ehnwamh2vdw3l6eunp77pbf7tyzliza", "to": "f01106668", "nonce": 78625, "method": "7", "height": "957075", "error": "failed to submit proof for bulk verification (RetCode=7):\n    github.com/filecoin-project/specs-actors/v5/actors/builtin.RequireSuccess\n        /go/pkg/mod/github.com/filecoin-project/specs-actors/[email protected]/actors/builtin/shared.go:64"}
2021-07-23T06:42:53.504Z	INFO	net/identify	identify/id.go:376	failed negotiate identify protocol with peer	{"peer": "12D3KooWDopk8bwA7u1Qgvf7uNk5D8hhHbMha5hDqjobPBjptV7n", "error": "stream reset"}
2021-07-23T06:43:00.501Z	INFO	bs:sess	session/session.go:459	No peers - broadcasting	{"session": 1192, "want-count": 1}
2021-07-23T06:43:00.584Z	INFO	bs:sess	session/session.go:459	No peers - broadcasting	{"session": 1193, "want-count": 1}
2021-07-23T06:43:00.606Z	INFO	bs:sess	session/session.go:459	No peers - broadcasting	{"session": 1194, "want-count": 1}
2021-07-23T06:43:22.687Z	INFO	net/identify	identify/id.go:376	failed negotiate identify protocol with peer	{"peer": "12D3KooWQB5BU4G3HHK51soZnoaQkWWt39tCAgvVjtb1LHPTLPEA", "error": "stream reset"}
2021-07-23T06:43:30.608Z	INFO	bitswap_network	network/ipfs_impl.go:188	send message to 12D3KooWFybXR4JZo1gXqVFw3rpnQGKKiWoQ37QoTrJEzrVZzhQR failed but context was not Done: context deadline exceeded
2021-07-23T06:43:30.620Z	INFO	bitswap_network	network/ipfs_impl.go:188	send message to 12D3KooWRMd5K7urZeS83edRtU26Sk7S2SbJDQW2iYDiszU75nzC failed but context was not Done: context deadline exceeded
2021-07-23T06:43:34.821Z	INFO	net/identify	identify/id.go:376	failed negotiate identify protocol with peer	{"peer": "12D3KooWRMd5K7urZeS83edRtU26Sk7S2SbJDQW2iYDiszU75nzC", "error": "stream reset"}
2021-07-23T06:43:42.895Z	WARN	sub	sub/incoming.go:104	received block with large delay from miner	{"block": "bafy2bzacedxosuibebrzx7brdlklpgqiazzyhtmeklxs3i2sgd4cokxfqc25q", "delay": 24162, "miner": "f0442370"}
2021-07-23T06:43:44.876Z	INFO	chain	chain/sync.go:700	block validation	{"took": 63.920428705, "height": "957076", "age": 3944.876146545}

Repo Steps

Normal start

[Reiers]

Hi @vae520283995

Thanks for the report. The issue you are experiencing lies elsewhere.

Moving this issue to Lotus Discussions for help and troubleshooting.

Closing ticket.

[LexLuthr]

@vae520283995 Hi, do you still need help with slow chain sync?

[vae520283995]

@vae520283995 Hi, do you still need help with slow chain sync?

I improved the iops and it works fine now