Skip to content

Commit 2ffae87

Browse files
bwbushbwbush
authored
Redesign/rerun CIP figures at sim-cli 1.3.1 (#574)
* Redesigned CIP experiment for `sim-cli` 1.3.1 * Completed rerun of CIP figures at sim-rs 1.3.1 * Updated logbook
1 parent 17542f3 commit 2ffae87

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

44 files changed

+1349
-1166
lines changed

‎Logbook.md‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,11 @@
11
# Leios logbook
22

3+
## 2025-10-13
4+
5+
### Regenerated CIP figures
6+
7+
The [CIP figures](analysis/sims/cip/) were regenerated for the new `sim-rs-1.3.1` tags.
8+
39
## 2025-10-11
410

511
### Parameter-sweep experiment for Markovian model

‎analysis/sims/cip/analysis.ipynb‎

Lines changed: 601 additions & 605 deletions
Large diffs are not rendered by default.

‎analysis/sims/cip/combine-results.sh‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ do
1313
then
1414
FRACT=1.00
1515
else
16-
FRACT=0.25
16+
FRACT=0.15
1717
fi
1818
(
1919
echo "$HL,$HR"

‎analysis/sims/cip/experiments.list‎

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,13 @@
1-
experiments/NA,0.050/run.sh
1+
experiments/NA,0.001/run.sh
22
experiments/NA,0.100/run.sh
33
experiments/NA,0.150/run.sh
44
experiments/NA,0.200/run.sh
55
experiments/NA,0.250/run.sh
66
experiments/NA,0.300/run.sh
7-
experiments/1000,0.150/run.sh
8-
experiments/2000,0.150/run.sh
9-
experiments/5000,0.150/run.sh
10-
experiments/10000,0.150/run.sh
11-
experiments/20000,0.150/run.sh
12-
experiments/50000,0.150/run.sh
7+
experiments/NA,0.350/run.sh
8+
experiments/1000,0.250/run.sh
9+
experiments/2000,0.250/run.sh
10+
experiments/5000,0.250/run.sh
11+
experiments/10000,0.250/run.sh
12+
experiments/20000,0.250/run.sh
13+
experiments/50000,0.250/run.sh

‎analysis/sims/cip/experiments/1000,0.150/case.csv‎ renamed to ‎analysis/sims/cip/experiments/1000,0.250/case.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
Network,Bandwidth,CPU,Diffusion duration,Voting duration,Max EB size,Tx size,Throughput,Plutus,Tx start [s],Tx stop [s],Sim stop [s]
2-
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,1000 Gstep/EB,60,960,1500
2+
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.250 TxMB/s,1000 Gstep/EB,60,960,1500

‎analysis/sims/cip/experiments/1000,0.150/config.yaml‎ renamed to ‎analysis/sims/cip/experiments/1000,0.250/config.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
"tx-stop-time": 960,
2323
"tx-generation-distribution": {
2424
"distribution": "constant",
25-
"value": 10.000
25+
"value": 6.000
2626
},
2727
"tx-size-bytes-distribution": {
2828
"distribution": "constant",
@@ -33,7 +33,7 @@
3333
"distribution": "constant",
3434
"value": 0
3535
},
36-
"tx-validation-cpu-time-ms": 0.7367500000000001,
36+
"tx-validation-cpu-time-ms": 0.54701,
3737
"tx-max-size-bytes": 16384,
3838
"rb-generation-probability": 0.05,
3939
"rb-head-size-bytes": 1024,

‎analysis/sims/cip/experiments/1000,0.150/run.sh‎ renamed to ‎analysis/sims/cip/experiments/1000,0.250/run.sh‎

File renamed without changes.

‎analysis/sims/cip/experiments/5000,0.150/summary.txt‎ renamed to ‎analysis/sims/cip/experiments/1000,0.250/summary.txt‎

Lines changed: 47 additions & 43 deletions
Original file line numberDiff line numberDiff line change
@@ -1,93 +1,97 @@
1-
INFO praos: sim_cli::events: 90001 transactions(s) were generated in total.
2-
INFO praos: sim_cli::events: 64 naive praos block(s) were published.
3-
INFO praos: sim_cli::events: 1436 slot(s) had no naive praos blocks.
4-
INFO praos: sim_cli::events: 90001 transaction(s) (135.00 MB) finalized in a naive praos block.
1+
INFO praos: sim_cli::events: 150001 transactions(s) were generated in total.
2+
INFO praos: sim_cli::events: 66 naive praos block(s) were published.
3+
INFO praos: sim_cli::events: 1434 slot(s) had no naive praos blocks.
4+
INFO praos: sim_cli::events: 150001 transaction(s) (225.00 MB) finalized in a naive praos block.
55
INFO praos: sim_cli::events: 0 transaction(s) (0 B) did not reach a naive praos block.
66
INFO praos: sim_cli::events: Pool 3 published 1 naive praos block(s)
7+
INFO praos: sim_cli::events: Pool 35 published 0 naive praos block(s)
8+
INFO praos: sim_cli::events: Pool 35 failed to publish 1 naive praos block(s) due to slot battles.
79
INFO praos: sim_cli::events: Pool 38 published 1 naive praos block(s)
8-
INFO praos: sim_cli::events: Pool 41 published 1 naive praos block(s)
910
INFO praos: sim_cli::events: Pool 42 published 1 naive praos block(s)
10-
INFO praos: sim_cli::events: Pool 43 published 1 naive praos block(s)
1111
INFO praos: sim_cli::events: Pool 45 published 1 naive praos block(s)
1212
INFO praos: sim_cli::events: Pool 46 published 1 naive praos block(s)
1313
INFO praos: sim_cli::events: Pool 50 published 1 naive praos block(s)
1414
INFO praos: sim_cli::events: Pool 53 published 1 naive praos block(s)
1515
INFO praos: sim_cli::events: Pool 54 published 1 naive praos block(s)
1616
INFO praos: sim_cli::events: Pool 58 published 1 naive praos block(s)
1717
INFO praos: sim_cli::events: Pool 59 published 1 naive praos block(s)
18+
INFO praos: sim_cli::events: Pool 60 published 1 naive praos block(s)
1819
INFO praos: sim_cli::events: Pool 62 published 1 naive praos block(s)
19-
INFO praos: sim_cli::events: Pool 67 published 1 naive praos block(s)
20+
INFO praos: sim_cli::events: Pool 66 published 1 naive praos block(s)
21+
INFO praos: sim_cli::events: Pool 67 published 2 naive praos block(s)
22+
INFO praos: sim_cli::events: Pool 68 published 0 naive praos block(s)
2023
INFO praos: sim_cli::events: Pool 68 failed to publish 1 naive praos block(s) due to slot battles.
21-
INFO praos: sim_cli::events: Pool 70 published 1 naive praos block(s)
22-
INFO praos: sim_cli::events: Pool 74 published 1 naive praos block(s)
24+
INFO praos: sim_cli::events: Pool 70 published 2 naive praos block(s)
2325
INFO praos: sim_cli::events: Pool 93 published 1 naive praos block(s)
26+
INFO praos: sim_cli::events: Pool 96 published 1 naive praos block(s)
27+
INFO praos: sim_cli::events: Pool 100 published 1 naive praos block(s)
28+
INFO praos: sim_cli::events: Pool 106 published 1 naive praos block(s)
2429
INFO praos: sim_cli::events: Pool 109 published 1 naive praos block(s)
25-
INFO praos: sim_cli::events: Pool 121 published 1 naive praos block(s)
30+
INFO praos: sim_cli::events: Pool 121 published 2 naive praos block(s)
2631
INFO praos: sim_cli::events: Pool 132 published 1 naive praos block(s)
2732
INFO praos: sim_cli::events: Pool 136 published 1 naive praos block(s)
2833
INFO praos: sim_cli::events: Pool 138 published 1 naive praos block(s)
2934
INFO praos: sim_cli::events: Pool 351 published 1 naive praos block(s)
30-
INFO praos: sim_cli::events: Pool 361 published 1 naive praos block(s)
3135
INFO praos: sim_cli::events: Pool 362 published 1 naive praos block(s)
32-
INFO praos: sim_cli::events: Pool 367 published 1 naive praos block(s)
3336
INFO praos: sim_cli::events: Pool 371 published 1 naive praos block(s)
3437
INFO praos: sim_cli::events: Pool 376 published 1 naive praos block(s)
35-
INFO praos: sim_cli::events: Pool 418 published 1 naive praos block(s)
3638
INFO praos: sim_cli::events: Pool 429 published 1 naive praos block(s)
3739
INFO praos: sim_cli::events: Pool 431 published 2 naive praos block(s)
38-
INFO praos: sim_cli::events: Pool 439 published 2 naive praos block(s)
39-
INFO praos: sim_cli::events: Pool 442 published 2 naive praos block(s)
40+
INFO praos: sim_cli::events: Pool 434 published 1 naive praos block(s)
41+
INFO praos: sim_cli::events: Pool 442 published 1 naive praos block(s)
4042
INFO praos: sim_cli::events: Pool 446 published 1 naive praos block(s)
4143
INFO praos: sim_cli::events: Pool 477 published 1 naive praos block(s)
4244
INFO praos: sim_cli::events: Pool 478 published 1 naive praos block(s)
4345
INFO praos: sim_cli::events: Pool 481 published 1 naive praos block(s)
4446
INFO praos: sim_cli::events: Pool 510 published 1 naive praos block(s)
47+
INFO praos: sim_cli::events: Pool 511 published 1 naive praos block(s)
48+
INFO praos: sim_cli::events: Pool 514 published 1 naive praos block(s)
4549
INFO praos: sim_cli::events: Pool 518 published 2 naive praos block(s)
46-
INFO praos: sim_cli::events: Pool 524 published 1 naive praos block(s)
47-
INFO praos: sim_cli::events: Pool 526 published 1 naive praos block(s)
48-
INFO praos: sim_cli::events: Pool 527 published 2 naive praos block(s)
50+
INFO praos: sim_cli::events: Pool 527 published 1 naive praos block(s)
4951
INFO praos: sim_cli::events: Pool 528 published 1 naive praos block(s)
50-
INFO praos: sim_cli::events: Pool 532 published 1 naive praos block(s)
5152
INFO praos: sim_cli::events: Pool 535 published 1 naive praos block(s)
52-
INFO praos: sim_cli::events: Pool 536 published 1 naive praos block(s)
53-
INFO praos: sim_cli::events: Pool 537 published 1 naive praos block(s)
53+
INFO praos: sim_cli::events: Pool 537 published 2 naive praos block(s)
5454
INFO praos: sim_cli::events: Pool 539 published 1 naive praos block(s)
55-
INFO praos: sim_cli::events: Pool 540 published 2 naive praos block(s)
55+
INFO praos: sim_cli::events: Pool 540 published 1 naive praos block(s)
56+
INFO praos: sim_cli::events: Pool 546 published 2 naive praos block(s)
57+
INFO praos: sim_cli::events: Pool 552 published 1 naive praos block(s)
58+
INFO praos: sim_cli::events: Pool 557 published 1 naive praos block(s)
5659
INFO praos: sim_cli::events: Pool 560 published 1 naive praos block(s)
60+
INFO praos: sim_cli::events: Pool 561 published 1 naive praos block(s)
5761
INFO praos: sim_cli::events: Pool 562 published 1 naive praos block(s)
58-
INFO praos: sim_cli::events: Pool 565 published 1 naive praos block(s)
62+
INFO praos: sim_cli::events: Pool 564 published 1 naive praos block(s)
5963
INFO praos: sim_cli::events: Pool 568 published 1 naive praos block(s)
6064
INFO praos: sim_cli::events: Pool 739 published 1 naive praos block(s)
6165
INFO praos: sim_cli::events: Pool 741 published 1 naive praos block(s)
62-
INFO praos: sim_cli::events: Pool 742 published 1 naive praos block(s)
63-
INFO praos: sim_cli::events: Pool 745 published 2 naive praos block(s)
66+
INFO praos: sim_cli::events: Pool 742 published 2 naive praos block(s)
67+
INFO praos: sim_cli::events: Pool 745 published 1 naive praos block(s)
6468
INFO leios: sim_cli::events: 0 IB(s) were generated, on average 0.000 IB(s) per slot.
65-
INFO leios: sim_cli::events: 0 out of 90001 transaction(s) were included in at least one IB.
69+
INFO leios: sim_cli::events: 0 out of 150001 transaction(s) were included in at least one IB.
6670
INFO leios: sim_cli::events: The average age of the pending transactions is NaNs (stddev NaN).
6771
INFO leios: sim_cli::events: Each transaction was included in an average of NaN IB(s) (stddev NaN).
6872
INFO leios: sim_cli::events: Each IB contained an average of NaN transaction(s) (stddev NaN) and an average of 0 B (stddev 0 B). 0 IB(s) were empty.
6973
INFO leios: sim_cli::events: Each node received an average of 0.000 IB(s) (stddev 0.000).
70-
INFO leios: sim_cli::events: 45 EB(s) were generated; on average there were 0.030 EB(s) per slot.
71-
INFO leios: sim_cli::events: Each EB contained an average of 5627.200 transaction(s) (stddev 2007.952). 0 EB(s) were empty.
74+
INFO leios: sim_cli::events: 44 EB(s) were generated; on average there were 0.029 EB(s) per slot.
75+
INFO leios: sim_cli::events: Each EB contained an average of 5816.750 transaction(s) (stddev 1788.274). 0 EB(s) were empty.
7276
INFO leios: sim_cli::events: Each EB contained an average of 0.000 IB(s) (stddev 0.000). 0 EB(s) were empty.
7377
INFO leios: sim_cli::events: Each IB was included in an average of NaN EB(s) (stddev NaN).
7478
INFO leios: sim_cli::events: 0 out of 0 IBs were included in at least one EB.
7579
INFO leios: sim_cli::events: 0 out of 0 IBs expired before they reached an EB.
76-
INFO leios: sim_cli::events: 22 out of 45 EBs expired before an EB from their stage reached an RB.
77-
INFO leios: sim_cli::events: 89881 out of 90001 transaction(s) were included in at least one EB.
78-
INFO leios: sim_cli::events: 23092 total votes were generated.
79-
INFO leios: sim_cli::events: Each stake pool produced an average of 106.907 vote(s) (stddev 31.273).
80-
INFO leios: sim_cli::events: Each EB received an average of 524.818 vote(s) (stddev 144.232).
81-
INFO leios: sim_cli::events: There were 7716 bundle(s) of votes. Each bundle contained 2.993 vote(s) (stddev 1.625).
80+
INFO leios: sim_cli::events: 21 out of 44 EBs expired before an EB from their stage reached an RB.
81+
INFO leios: sim_cli::events: 149941 out of 150001 transaction(s) were included in at least one EB.
82+
INFO leios: sim_cli::events: 22795 total votes were generated.
83+
INFO leios: sim_cli::events: Each stake pool produced an average of 105.532 vote(s) (stddev 30.192).
84+
INFO leios: sim_cli::events: Each EB received an average of 530.116 vote(s) (stddev 146.592).
85+
INFO leios: sim_cli::events: There were 7617 bundle(s) of votes. Each bundle contained 2.993 vote(s) (stddev 1.627).
8286
INFO leios: sim_cli::events: 25 L1 block(s) had a Leios endorsement.
83-
INFO leios: sim_cli::events: 88741 tx(s) (133.11 MB) were referenced by a Leios endorsement.
84-
INFO leios: sim_cli::events: 1260 tx(s) (1.89 MB) were included directly in a Praos block.
85-
INFO leios: sim_cli::events: Spatial efficiency: 133.11 MB/8.31 MB (1601.059%) of Leios bytes were unique transactions.
86-
INFO leios: sim_cli::events: 51110 tx(s) (36.546%) referenced by a Leios endorsement were redundant.
87+
INFO leios: sim_cli::events: 148801 tx(s) (223.20 MB) were referenced by a Leios endorsement.
88+
INFO leios: sim_cli::events: 1200 tx(s) (1.80 MB) were included directly in a Praos block.
89+
INFO leios: sim_cli::events: Spatial efficiency: 223.20 MB/8.40 MB (2656.989%) of Leios bytes were unique transactions.
90+
INFO leios: sim_cli::events: 0 tx(s) (0.000%) referenced by a Leios endorsement were redundant.
8791
INFO leios: sim_cli::events: Each transaction took an average of NaNs (stddev NaN) to be included in an IB.
88-
INFO leios: sim_cli::events: Each transaction took an average of 20.768s (stddev 15.433) to be included in an EB.
89-
INFO leios: sim_cli::events: Each transaction took an average of 59.414s (stddev 20.693) to be included in a block.
90-
INFO network: sim_cli::events: 67410749 TX message(s) were sent. 67410749 of them were received (100.000%).
92+
INFO leios: sim_cli::events: Each transaction took an average of 19.892s (stddev 14.985) to be included in an EB.
93+
INFO leios: sim_cli::events: Each transaction took an average of 57.041s (stddev 19.190) to be included in a block.
94+
INFO network: sim_cli::events: 112350749 TX message(s) were sent. 112350749 of them were received (100.000%).
9195
INFO network: sim_cli::events: 0 IB message(s) were sent. 0 of them were received (NaN%).
92-
INFO network: sim_cli::events: 33249 EB message(s) were sent. 33249 of them were received (100.000%).
93-
INFO network: sim_cli::events: 5779284 Vote message(s) were sent. 5779284 of them were received (100.000%).
96+
INFO network: sim_cli::events: 32500 EB message(s) were sent. 32500 of them were received (100.000%).
97+
INFO network: sim_cli::events: 5705133 Vote message(s) were sent. 5705133 of them were received (100.000%).

‎analysis/sims/cip/experiments/20000,0.150/case.csv‎ renamed to ‎analysis/sims/cip/experiments/10000,0.250/case.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
Network,Bandwidth,CPU,Diffusion duration,Voting duration,Max EB size,Tx size,Throughput,Plutus,Tx start [s],Tx stop [s],Sim stop [s]
2-
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,20000 Gstep/EB,60,960,1500
2+
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.250 TxMB/s,10000 Gstep/EB,60,960,1500

‎analysis/sims/cip/experiments/10000,0.150/config.yaml‎ renamed to ‎analysis/sims/cip/experiments/10000,0.250/config.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
"tx-stop-time": 960,
2323
"tx-generation-distribution": {
2424
"distribution": "constant",
25-
"value": 10.000
25+
"value": 6.000
2626
},
2727
"tx-size-bytes-distribution": {
2828
"distribution": "constant",
@@ -33,7 +33,7 @@
3333
"distribution": "constant",
3434
"value": 0
3535
},
36-
"tx-validation-cpu-time-ms": 5.0059000000000005,
36+
"tx-validation-cpu-time-ms": 3.1085,
3737
"tx-max-size-bytes": 16384,
3838
"rb-generation-probability": 0.05,
3939
"rb-head-size-bytes": 1024,

0 commit comments

Comments
 (0)