Skip to content

Commit 7f68ffc

Browse files
bwbushbwbush
authored
Rerun CIP figures at sim-cli 1.3.0 (#526)
* Bumped `sim-cli` to 1.3.0 * Re-ran CIP figures
1 parent b74f172 commit 7f68ffc

File tree

37 files changed

+1319
-1270
lines changed

37 files changed

+1319
-1270
lines changed

‎analysis/sims/cip/analysis.ipynb‎

Lines changed: 609 additions & 572 deletions
Large diffs are not rendered by default.

‎analysis/sims/cip/experiments/1000,0.150/case.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
Network,Bandwidth,CPU,Diffusion duration,Voting duration,Max EB size,Tx size,Throughput,Plutus,Tx start [s],Tx stop [s],Sim stop [s]
2-
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 7 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,1000 Gstep/EB,60,960,1500
2+
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,1000 Gstep/EB,60,960,1500

‎analysis/sims/cip/experiments/1000,0.150/config.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
],
77
"leios-variant": "linear-with-tx-references",
88
"linear-eb-propagation-criteria": "eb-received",
9-
"linear-vote-stage-length-slots": 7,
9+
"linear-vote-stage-length-slots": 4,
1010
"linear-diffuse-stage-length-slots": 7,
1111
"praos-fallback-enabled": true,
1212
"leios-stage-active-voting-slots": 1,
@@ -17,7 +17,7 @@
1717
"eb-referenced-txs-max-size-bytes": 12000000,
1818
"eb-size-bytes-constant": 240,
1919
"eb-size-bytes-per-ib": 32,
20-
"leios-header-diffusion-time-ms": 2000.0,
20+
"leios-header-diffusion-time-ms": 1000.0,
2121
"tx-start-time": 60,
2222
"tx-stop-time": 960,
2323
"tx-generation-distribution": {
@@ -62,6 +62,6 @@
6262
"cert-generation-cpu-time-ms-per-node": 0,
6363
"cert-validation-cpu-time-ms-constant": 157.2,
6464
"cert-validation-cpu-time-ms-per-node": 0,
65-
"leios-stage-length-slots": 7,
65+
"leios-stage-length-slots": 4,
6666
"eb-body-avg-size-bytes": 12000000
6767
}

‎analysis/sims/cip/experiments/1000,0.150/summary.txt‎

Lines changed: 52 additions & 47 deletions
Original file line numberDiff line numberDiff line change
@@ -1,89 +1,94 @@
11
INFO praos: sim_cli::events: 90001 transactions(s) were generated in total.
2-
INFO praos: sim_cli::events: 60 naive praos block(s) were published.
3-
INFO praos: sim_cli::events: 1440 slot(s) had no naive praos blocks.
2+
INFO praos: sim_cli::events: 64 naive praos block(s) were published.
3+
INFO praos: sim_cli::events: 1436 slot(s) had no naive praos blocks.
44
INFO praos: sim_cli::events: 90001 transaction(s) (135.00 MB) finalized in a naive praos block.
55
INFO praos: sim_cli::events: 0 transaction(s) (0 B) did not reach a naive praos block.
66
INFO praos: sim_cli::events: Pool 3 published 1 naive praos block(s)
7-
INFO praos: sim_cli::events: Pool 35 published 1 naive praos block(s)
87
INFO praos: sim_cli::events: Pool 38 published 1 naive praos block(s)
9-
INFO praos: sim_cli::events: Pool 40 published 1 naive praos block(s)
108
INFO praos: sim_cli::events: Pool 41 published 1 naive praos block(s)
119
INFO praos: sim_cli::events: Pool 42 published 1 naive praos block(s)
10+
INFO praos: sim_cli::events: Pool 43 published 1 naive praos block(s)
11+
INFO praos: sim_cli::events: Pool 45 published 1 naive praos block(s)
1212
INFO praos: sim_cli::events: Pool 46 published 1 naive praos block(s)
13+
INFO praos: sim_cli::events: Pool 50 published 1 naive praos block(s)
1314
INFO praos: sim_cli::events: Pool 53 published 1 naive praos block(s)
1415
INFO praos: sim_cli::events: Pool 54 published 1 naive praos block(s)
15-
INFO praos: sim_cli::events: Pool 55 published 1 naive praos block(s)
1616
INFO praos: sim_cli::events: Pool 58 published 1 naive praos block(s)
17-
INFO praos: sim_cli::events: Pool 59 published 2 naive praos block(s)
17+
INFO praos: sim_cli::events: Pool 59 published 1 naive praos block(s)
1818
INFO praos: sim_cli::events: Pool 62 published 1 naive praos block(s)
1919
INFO praos: sim_cli::events: Pool 67 published 1 naive praos block(s)
2020
INFO praos: sim_cli::events: Pool 68 published 0 naive praos block(s)
2121
INFO praos: sim_cli::events: Pool 68 failed to publish 1 naive praos block(s) due to slot battles.
22-
INFO praos: sim_cli::events: Pool 69 published 1 naive praos block(s)
23-
INFO praos: sim_cli::events: Pool 73 published 1 naive praos block(s)
24-
INFO praos: sim_cli::events: Pool 86 published 1 naive praos block(s)
22+
INFO praos: sim_cli::events: Pool 70 published 1 naive praos block(s)
23+
INFO praos: sim_cli::events: Pool 74 published 1 naive praos block(s)
2524
INFO praos: sim_cli::events: Pool 93 published 1 naive praos block(s)
25+
INFO praos: sim_cli::events: Pool 108 published 1 naive praos block(s)
2626
INFO praos: sim_cli::events: Pool 109 published 1 naive praos block(s)
2727
INFO praos: sim_cli::events: Pool 121 published 1 naive praos block(s)
28-
INFO praos: sim_cli::events: Pool 123 published 1 naive praos block(s)
29-
INFO praos: sim_cli::events: Pool 127 published 1 naive praos block(s)
30-
INFO praos: sim_cli::events: Pool 130 published 1 naive praos block(s)
3128
INFO praos: sim_cli::events: Pool 132 published 1 naive praos block(s)
3229
INFO praos: sim_cli::events: Pool 136 published 1 naive praos block(s)
30+
INFO praos: sim_cli::events: Pool 138 published 1 naive praos block(s)
3331
INFO praos: sim_cli::events: Pool 351 published 1 naive praos block(s)
32+
INFO praos: sim_cli::events: Pool 361 published 1 naive praos block(s)
3433
INFO praos: sim_cli::events: Pool 362 published 1 naive praos block(s)
35-
INFO praos: sim_cli::events: Pool 423 published 1 naive praos block(s)
34+
INFO praos: sim_cli::events: Pool 367 published 1 naive praos block(s)
35+
INFO praos: sim_cli::events: Pool 371 published 1 naive praos block(s)
36+
INFO praos: sim_cli::events: Pool 418 published 1 naive praos block(s)
37+
INFO praos: sim_cli::events: Pool 429 published 1 naive praos block(s)
3638
INFO praos: sim_cli::events: Pool 431 published 2 naive praos block(s)
37-
INFO praos: sim_cli::events: Pool 474 published 1 naive praos block(s)
38-
INFO praos: sim_cli::events: Pool 477 published 2 naive praos block(s)
39+
INFO praos: sim_cli::events: Pool 439 published 2 naive praos block(s)
40+
INFO praos: sim_cli::events: Pool 442 published 2 naive praos block(s)
41+
INFO praos: sim_cli::events: Pool 446 published 1 naive praos block(s)
42+
INFO praos: sim_cli::events: Pool 477 published 1 naive praos block(s)
3943
INFO praos: sim_cli::events: Pool 478 published 1 naive praos block(s)
40-
INFO praos: sim_cli::events: Pool 514 published 1 naive praos block(s)
41-
INFO praos: sim_cli::events: Pool 517 published 1 naive praos block(s)
42-
INFO praos: sim_cli::events: Pool 518 published 1 naive praos block(s)
43-
INFO praos: sim_cli::events: Pool 519 published 1 naive praos block(s)
44-
INFO praos: sim_cli::events: Pool 521 published 1 naive praos block(s)
44+
INFO praos: sim_cli::events: Pool 481 published 1 naive praos block(s)
45+
INFO praos: sim_cli::events: Pool 510 published 1 naive praos block(s)
46+
INFO praos: sim_cli::events: Pool 518 published 2 naive praos block(s)
47+
INFO praos: sim_cli::events: Pool 524 published 1 naive praos block(s)
48+
INFO praos: sim_cli::events: Pool 526 published 1 naive praos block(s)
49+
INFO praos: sim_cli::events: Pool 527 published 2 naive praos block(s)
4550
INFO praos: sim_cli::events: Pool 528 published 1 naive praos block(s)
46-
INFO praos: sim_cli::events: Pool 534 published 1 naive praos block(s)
47-
INFO praos: sim_cli::events: Pool 535 published 2 naive praos block(s)
48-
INFO praos: sim_cli::events: Pool 539 published 2 naive praos block(s)
49-
INFO praos: sim_cli::events: Pool 540 published 1 naive praos block(s)
50-
INFO praos: sim_cli::events: Pool 542 published 1 naive praos block(s)
51-
INFO praos: sim_cli::events: Pool 544 published 1 naive praos block(s)
51+
INFO praos: sim_cli::events: Pool 532 published 1 naive praos block(s)
52+
INFO praos: sim_cli::events: Pool 535 published 1 naive praos block(s)
53+
INFO praos: sim_cli::events: Pool 536 published 1 naive praos block(s)
54+
INFO praos: sim_cli::events: Pool 537 published 1 naive praos block(s)
55+
INFO praos: sim_cli::events: Pool 539 published 1 naive praos block(s)
56+
INFO praos: sim_cli::events: Pool 540 published 2 naive praos block(s)
5257
INFO praos: sim_cli::events: Pool 560 published 1 naive praos block(s)
5358
INFO praos: sim_cli::events: Pool 562 published 1 naive praos block(s)
59+
INFO praos: sim_cli::events: Pool 565 published 1 naive praos block(s)
60+
INFO praos: sim_cli::events: Pool 568 published 1 naive praos block(s)
5461
INFO praos: sim_cli::events: Pool 739 published 1 naive praos block(s)
55-
INFO praos: sim_cli::events: Pool 741 published 3 naive praos block(s)
62+
INFO praos: sim_cli::events: Pool 741 published 1 naive praos block(s)
5663
INFO praos: sim_cli::events: Pool 742 published 1 naive praos block(s)
57-
INFO praos: sim_cli::events: Pool 744 published 2 naive praos block(s)
58-
INFO praos: sim_cli::events: Pool 745 published 1 naive praos block(s)
59-
INFO praos: sim_cli::events: Pool 747 published 1 naive praos block(s)
64+
INFO praos: sim_cli::events: Pool 745 published 2 naive praos block(s)
6065
INFO leios: sim_cli::events: 0 IB(s) were generated, on average 0.000 IB(s) per slot.
6166
INFO leios: sim_cli::events: 0 out of 90001 transaction(s) were included in at least one IB.
6267
INFO leios: sim_cli::events: The average age of the pending transactions is NaNs (stddev NaN).
6368
INFO leios: sim_cli::events: Each transaction was included in an average of NaN IB(s) (stddev NaN).
6469
INFO leios: sim_cli::events: Each IB contained an average of NaN transaction(s) (stddev NaN) and an average of 0 B (stddev 0 B). 0 IB(s) were empty.
6570
INFO leios: sim_cli::events: Each node received an average of 0.000 IB(s) (stddev 0.000).
66-
INFO leios: sim_cli::events: 61 EB(s) were generated; on average there were 0.041 EB(s) per slot.
67-
INFO leios: sim_cli::events: Each EB contained an average of 3280.590 transaction(s) (stddev 2900.615). 18 EB(s) were empty.
68-
INFO leios: sim_cli::events: Each EB contained an average of 0.000 IB(s) (stddev 0.000). 18 EB(s) were empty.
71+
INFO leios: sim_cli::events: 45 EB(s) were generated; on average there were 0.030 EB(s) per slot.
72+
INFO leios: sim_cli::events: Each EB contained an average of 5646.667 transaction(s) (stddev 1965.568). 0 EB(s) were empty.
73+
INFO leios: sim_cli::events: Each EB contained an average of 0.000 IB(s) (stddev 0.000). 0 EB(s) were empty.
6974
INFO leios: sim_cli::events: Each IB was included in an average of NaN EB(s) (stddev NaN).
7075
INFO leios: sim_cli::events: 0 out of 0 IBs were included in at least one EB.
7176
INFO leios: sim_cli::events: 0 out of 0 IBs expired before they reached an EB.
72-
INFO leios: sim_cli::events: 13 out of 61 EBs expired before an EB from their stage reached an RB.
77+
INFO leios: sim_cli::events: 21 out of 45 EBs expired before an EB from their stage reached an RB.
7378
INFO leios: sim_cli::events: 89941 out of 90001 transaction(s) were included in at least one EB.
74-
INFO leios: sim_cli::events: 29534 total votes were generated.
75-
INFO leios: sim_cli::events: Each stake pool produced an average of 136.731 vote(s) (stddev 26.189).
76-
INFO leios: sim_cli::events: Each EB received an average of 500.576 vote(s) (stddev 215.773).
77-
INFO leios: sim_cli::events: There were 9893 bundle(s) of votes. Each bundle contained 2.985 vote(s) (stddev 1.617).
78-
INFO leios: sim_cli::events: 50 L1 block(s) had a Leios endorsement.
79-
INFO leios: sim_cli::events: 89521 tx(s) (134.28 MB) were referenced by a Leios endorsement.
80-
INFO leios: sim_cli::events: 480 tx(s) (720 kB) were included directly in a Praos block.
81-
INFO leios: sim_cli::events: Spatial efficiency: 134.28 MB/6.82 MB (1969.413%) of Leios bytes were unique transactions.
82-
INFO leios: sim_cli::events: 72522 tx(s) (44.755%) referenced by a Leios endorsement were redundant.
79+
INFO leios: sim_cli::events: 23446 total votes were generated.
80+
INFO leios: sim_cli::events: Each stake pool produced an average of 108.546 vote(s) (stddev 30.852).
81+
INFO leios: sim_cli::events: Each EB received an average of 532.864 vote(s) (stddev 144.800).
82+
INFO leios: sim_cli::events: There were 7834 bundle(s) of votes. Each bundle contained 2.993 vote(s) (stddev 1.624).
83+
INFO leios: sim_cli::events: 26 L1 block(s) had a Leios endorsement.
84+
INFO leios: sim_cli::events: 88801 tx(s) (133.20 MB) were referenced by a Leios endorsement.
85+
INFO leios: sim_cli::events: 1200 tx(s) (1.80 MB) were included directly in a Praos block.
86+
INFO leios: sim_cli::events: Spatial efficiency: 133.20 MB/8.35 MB (1595.228%) of Leios bytes were unique transactions.
87+
INFO leios: sim_cli::events: 57456 tx(s) (39.284%) referenced by a Leios endorsement were redundant.
8388
INFO leios: sim_cli::events: Each transaction took an average of NaNs (stddev NaN) to be included in an IB.
84-
INFO leios: sim_cli::events: Each transaction took an average of 21.203s (stddev 17.274) to be included in an EB.
85-
INFO leios: sim_cli::events: Each transaction took an average of 49.518s (stddev 26.613) to be included in a block.
89+
INFO leios: sim_cli::events: Each transaction took an average of 21.103s (stddev 15.879) to be included in an EB.
90+
INFO leios: sim_cli::events: Each transaction took an average of 58.701s (stddev 19.546) to be included in a block.
8691
INFO network: sim_cli::events: 67410749 TX message(s) were sent. 67410749 of them were received (100.000%).
8792
INFO network: sim_cli::events: 0 IB message(s) were sent. 0 of them were received (NaN%).
88-
INFO network: sim_cli::events: 45227 EB message(s) were sent. 45227 of them were received (100.000%).
89-
INFO network: sim_cli::events: 7409857 Vote message(s) were sent. 7409857 of them were received (100.000%).
93+
INFO network: sim_cli::events: 33249 EB message(s) were sent. 33249 of them were received (100.000%).
94+
INFO network: sim_cli::events: 5867666 Vote message(s) were sent. 5867666 of them were received (100.000%).

‎analysis/sims/cip/experiments/10000,0.150/case.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
Network,Bandwidth,CPU,Diffusion duration,Voting duration,Max EB size,Tx size,Throughput,Plutus,Tx start [s],Tx stop [s],Sim stop [s]
2-
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 7 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,10000 Gstep/EB,60,960,1500
2+
topology-v2,10 Mb/s,4 vCPU/node,L_diff = 7 slots,L_vote = 4 slots,12 MB/EB,1500 B/Tx,0.150 TxMB/s,10000 Gstep/EB,60,960,1500

‎analysis/sims/cip/experiments/10000,0.150/config.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66
],
77
"leios-variant": "linear-with-tx-references",
88
"linear-eb-propagation-criteria": "eb-received",
9-
"linear-vote-stage-length-slots": 7,
9+
"linear-vote-stage-length-slots": 4,
1010
"linear-diffuse-stage-length-slots": 7,
1111
"praos-fallback-enabled": true,
1212
"leios-stage-active-voting-slots": 1,
@@ -17,7 +17,7 @@
1717
"eb-referenced-txs-max-size-bytes": 12000000,
1818
"eb-size-bytes-constant": 240,
1919
"eb-size-bytes-per-ib": 32,
20-
"leios-header-diffusion-time-ms": 2000.0,
20+
"leios-header-diffusion-time-ms": 1000.0,
2121
"tx-start-time": 60,
2222
"tx-stop-time": 960,
2323
"tx-generation-distribution": {
@@ -62,6 +62,6 @@
6262
"cert-generation-cpu-time-ms-per-node": 0,
6363
"cert-validation-cpu-time-ms-constant": 157.2,
6464
"cert-validation-cpu-time-ms-per-node": 0,
65-
"leios-stage-length-slots": 7,
65+
"leios-stage-length-slots": 4,
6666
"eb-body-avg-size-bytes": 12000000
6767
}

0 commit comments

Comments
 (0)