lotus-bench prove not working

[seccentral]

Describe the bug
lotus-bench prove not working

To Reproduce
./lotus-bench prove

Expected behavior
[ results ]

Screenshots

fil@filecoin:~/benchmark$ ./lotus-bench prove
2021-02-15T21:14:33.544+0200    INFO    lotus-bench     lotus-bench/main.go:101 Starting lotus-bench
2021-02-15T21:14:33.544+0200    WARN    lotus-bench     lotus-bench/main.go:115 Usage: lotus-bench prove [input.json]:
    main.glob..func4
        /home/fil/lotus/cmd/lotus-bench/main.go:728
fil@filecoin:~/benchmark$ 

Version (run lotus version):

fil@filecoin:~/benchmark$ lotus version
Daemon:  1.4.1+mainnet+git.95e47cf99+api1.1.0
Local: lotus version 1.4.1+mainnet+git.95e47cf99

Additional context
compiled and ran as per documentation here

[kelvinyasu]

Got the same problem here too.. is any input file I need to specify to run the test?

[seccentral]

update: same problem with 1.4.2

[jennijuju]

https://github.com/filecoin-project/benchmarks#running-a-benchmark

[citizen-stig]

I've got same error as @seccentral , and correct target is indeed lotus-bench, not bench.

Also documentation in github only mentiones benchmark for sealing, but not for proving as in description.

Obviously lotus-bench prove requires some kind of json file as input. I've tried to give it empty json, and got following:

$ cat input.json
{}
$ ./lotus-bench prove input.json
2021-03-20T19:49:04.813+0100	INFO	lotus-bench	lotus-bench/main.go:77	Starting lotus-bench
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-3ea05428c9d11689f23529cde32fd30aabd50f7d2c93657c1d3650bca3e8ea9e.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-stacked-proof-of-replication-merkletree-poseidon_hasher-8-0-0-sha256_hasher-ecd683648512ab1765faa2a5f14bab48f676e633467f0aa8aad4b55dcb0652bb.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-0cfb4f178bbb71cf2ecfcd42accce558b27199ab4fb59cb78f2483fe21ef36d9.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-stacked-proof-of-replication-merkletree-poseidon_hasher-8-0-0-sha256_hasher-032d3138d22506ec0082ed72b2dcba18df18477904e35bafee82b3793b06832f.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-0170db1f394b35d995252228ee359194b13199d259380541dc529fb0099096b0.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-5294475db5237a2e83c3e52fd6c2b03859a1831d45ed08c4f35dbf9a803165a9.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-50c7368dea9593ed0989e70974d28024efa9d156d585b7eea1be22b2e753f331.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-8-2-b62098629d07946e9028127e70295ed996fe3ed25b0f9f88eb610a0ab4385a3c.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-stacked-proof-of-replication-merkletree-poseidon_hasher-8-0-0-sha256_hasher-6babf46ce344ae495d558e7770a585b2382d54f225af8ed0397b8be7c3fcd472.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-0-0-7d739b8cf60f1b0709eeebee7730e297683552e4b69cab6984ec0285663c5781.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-8-0-559e581f022bb4e4ec6e719e563bf0e026ad6de42e56c18714a2c692b1b88d7e.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-stacked-proof-of-replication-merkletree-poseidon_hasher-8-8-2-sha256_hasher-96f1b4a04c5c51e4759bbf224bbc2ef5a42c7100f16ec0637123f16a845ddfb2.vk is ok
2021-03-20T19:49:04.814+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-stacked-proof-of-replication-merkletree-poseidon_hasher-8-8-0-sha256_hasher-82a357d2f2ca81dc61bb45f4a762807aedee1b0a53fd6c4e77b46a01bfef7820.vk is ok
2021-03-20T19:49:04.819+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-8-2-2627e4006b67f99cef990c0a47d5426cb7ab0a0ad58fc1061547bf2d28b09def.vk is ok
2021-03-20T19:49:04.820+0100	INFO	build	[email protected]/paramfetch.go:138	Parameter file /var/tmp/filecoin-proof-parameters/v28-proof-of-spacetime-fallback-merkletree-poseidon_hasher-8-8-0-0377ded656c6f524f1618760bffe4e0a1c51d5a70c4509eedae8a27555733edc.vk is ok
2021-03-20T19:49:04.820+0100	INFO	build	[email protected]/paramfetch.go:162	parameter and key-fetching complete
2021-03-20T19:49:04.820+0100	WARN	lotus-bench	lotus-bench/main.go:91	unsupported sector size for miner: 0:
    github.com/filecoin-project/lotus/extern/sector-storage/ffiwrapper.SealProofTypeFromSectorSize
        /home/stig/lotus/extern/sector-storage/ffiwrapper/config.go:32
        

So the real question is, what data in this file is expected?

[seccentral]

@jennijuju, the problem is make: *** No rule to make target 'bench'. Stop.

Even if there was a bench target, the documentation at https://docs.filecoin.io/mine/lotus/benchmarks/#installation does not mention your link at all.
It does mention a lotus-bench target, which builds, which is the binary I ran and which outputs the same error/(bug/feature?)
Running in :

fil@filecoin:~/lotus$ git status -v
On branch master
Your branch is up to date with 'origin/master'.

Your link and the page at the official docs present conflicting information.

[seccentral]

I said it before, the documentation is misleading or incomplete, outdated.
Their answer ?
A url pointing to the bad documentation, and my ticket closed. Super unprofessional, corporate like, as if i had an open ticket to EA or microsoft tech support.
Pity.

[shotcollin]

I noticed while reading another issue that one (documented but not well-described) option of lotus-bench sealing is --save-commit2-input, which you can save to e.g. commit2-input.json. That file can then be used as the (required but undocumented) argument for lotus-bench prove.

[SgtCoin]

@shotcollin @seccentral

I will work on getting the documentation corrected. I confirmed the workaround in the post above does correct the issue for now.

1- Create the json file and run a sealing benchmark.

./lotus-bench sealing --save-commit2-input commit2-input.json

2- Use the file to run the proving benchmark.

./lotus-bench prove commit2-input.json

Please let me know if you have any questions.