Skip to content

statement-store performance benchmarks #9763

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 43 commits into
base: master
Choose a base branch
from
Open

statement-store performance benchmarks #9763

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
d7882cf
Add dummy test
AndreiEres Sep 16, 2025
cb8905e
Use only 2 validators
AndreiEres Sep 16, 2025
521e145
Set many collators
AndreiEres Sep 16, 2025
839256c
Send many statements
AndreiEres Sep 16, 2025
ba1102a
Save other session keys
AndreiEres Sep 16, 2025
6bd0dd4
Exchange symmetric keys
AndreiEres Sep 16, 2025
aa77e39
Add dirty req-res
AndreiEres Sep 17, 2025
016953c
Extract network spawning
AndreiEres Sep 17, 2025
434bed2
Move requests to participant
AndreiEres Sep 18, 2025
350bded
Request session keys only for group members
AndreiEres Sep 18, 2025
88adee8
Add acks
AndreiEres Sep 18, 2025
76df2bf
Add request acks
AndreiEres Sep 18, 2025
12f5356
Remove request id from channels
AndreiEres Sep 18, 2025
4fb7dcf
Add response acks
AndreiEres Sep 18, 2025
13f5903
Refactor acks
AndreiEres Sep 22, 2025
22bdaf4
Add retry to receiving
AndreiEres Sep 22, 2025
0be0d9f
Remove assert
AndreiEres Sep 22, 2025
83c5d65
Use async task for participants
AndreiEres Sep 22, 2025
58d6ca4
Update logging
AndreiEres Sep 22, 2025
eb6863a
Test with more participants
AndreiEres Sep 22, 2025
ef85b4b
Switch to many participants
AndreiEres Sep 22, 2025
677ba2c
Update
AndreiEres Sep 23, 2025
e575004
Increase statement-store limits
AndreiEres Sep 23, 2025
4ec1174
Change log level
AndreiEres Sep 23, 2025
1552999
Add stats
AndreiEres Sep 23, 2025
45fd673
Use custom runtime
AndreiEres Sep 23, 2025
9782eb9
Add basic stats
AndreiEres Sep 23, 2025
19dfb34
Add timeouts
AndreiEres Sep 23, 2025
d18d673
Dry
AndreiEres Sep 23, 2025
78ae251
Add RPC pool
AndreiEres Sep 24, 2025
69c1e8a
Update
AndreiEres Sep 24, 2025
d6438c6
Update the bench
AndreiEres Sep 29, 2025
26d5aee
Merge branch 'master' into AndreiEres/statement-store-bench
AndreiEres Oct 1, 2025
3f4bd12
Merge remote-tracking branch 'origin/master' into AndreiEres/statemen…
AndreiEres Oct 2, 2025
154a96f
Update the bench
AndreiEres Oct 2, 2025
d77bd22
Add memory stress test
AndreiEres Oct 7, 2025
6815671
Update stress test
AndreiEres Oct 10, 2025
b4a17a4
Remove extra logic from the test
AndreiEres Oct 10, 2025
6088289
Update network spawning
AndreiEres Oct 10, 2025
208ba74
Update
AndreiEres Oct 10, 2025
c238d26
Fix clippy warnings
AndreiEres Oct 10, 2025
5a8dcc8
Update formatting
AndreiEres Oct 14, 2025
db8380d
Update
AndreiEres Oct 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions cumulus/zombienet/zombienet-sdk/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,10 @@ zombienet-orchestrator = { workspace = true }
zombienet-configuration = { workspace = true }
cumulus-zombienet-sdk-helpers = { workspace = true }
sp-statement-store = { workspace = true, default-features = true }
sc-statement-store = { workspace = true, default-features = true }
sp-keyring = { workspace = true, default-features = true }
sp-core = { workspace = true, default-features = true }
codec = { workspace = true }
rstest = { workspace = true }

[features]
Expand Down
1 change: 1 addition & 0 deletions cumulus/zombienet/zombienet-sdk/tests/zombie_ci/mod.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,5 @@ mod pov_recovery;
mod rpc_collator_build_blocks;
mod runtime_upgrade;
mod statement_store;
mod statement_store_bench;
mod sync_blocks;
148 changes: 148 additions & 0 deletions cumulus/zombienet/zombienet-sdk/tests/zombie_ci/people-rococo-spec.json
View file
Open in desktop
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why can't we use an existing spec how is this different ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if this is the binary George sent, I think we can just modify people-rococo to just have validate-statement implementation as needed for the benchmark, anyway rococo is not live AFAIK.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it, so we need it because it is a rococo with statement-store pallet, let's just document the somewhere, so we don't forget what is in there.

Large diffs are not rendered by default.

Loading
Loading