Regression test for sim-cli 1.3.1 (#573)

bwbush · web-flow · commit e4eaaddc5f7b · 2025-10-10T14:58:00.000-06:00
* Designed regression test for sim-cli 1.3.1
* Ran regression study at sim-cli 1.3.1
* Updated logbook
diff --git a/Logbook.md b/Logbook.md
@@ -1,5 +1,23 @@
 # Leios logbook
 
+## 2025-10-10
+
+### Regression experiment on `sim-cli` 1.3.1
+
+See [analysis/sims/regression/analysis.ipynb](analysis/sims/regression/analysis.ipynb) for the results of a regression experiment of the new `sim-cli` version 1.3.1 versus earlier versions.
+
+## 2025-10-08
+
+### Instructions for running Leios simulations
+
+Instructurions for running the Leios simulators or re-running previous simulation experiments are now available [analysis/sims/ReadMe.md](analysis/sims/ReadMe.md):
+
+- [Building the tools](analysis/sims/ReadMe.md#building-the-tools)
+- [Running the simulators](analysis/sims/ReadMe.md#running-the-simulators)
+- [Running the trace processor](analysis/sims/ReadMe.md#running-the-trace-processor)
+- [Index of simulation studies](analysis/sims/ReadMe.md#index-of-simulation-studies)
+- [Re-reunning simulation studies](analysis/sims/ReadMe.md#re-reunning-simulation-studies)
+
 ## 2025-10-02
 
 ### Markovian simulator for Linear Leios
diff --git a/analysis/sims/regression/analysis.ipynb b/analysis/sims/regression/analysis.ipynb
diff --git a/analysis/sims/regression/experiments.list b/analysis/sims/regression/experiments.list
@@ -1,3 +1,4 @@
+experiments/1.3.1/run.sh
 experiments/1.3.0/run.sh
 experiments/1.2.0/run.sh
 experiments/1.1.0/run.sh
diff --git a/analysis/sims/regression/experiments/1.3.0/summary.txt b/analysis/sims/regression/experiments/1.3.0/summary.txt
@@ -1,83 +1,99 @@
- INFO praos: sim_cli::events: 90001 transactions(s) were generated in total.
- INFO praos: sim_cli::events: 49 naive praos block(s) were published.
- INFO praos: sim_cli::events: 1151 slot(s) had no naive praos blocks.
- INFO praos: sim_cli::events: 90001 transaction(s) (135.00 MB) finalized in a naive praos block.
+ INFO praos: sim_cli::events: 60001 transactions(s) were generated in total.
+ INFO praos: sim_cli::events: 66 naive praos block(s) were published.
+ INFO praos: sim_cli::events: 1134 slot(s) had no naive praos blocks.
+ INFO praos: sim_cli::events: 60001 transaction(s) (90.00 MB) finalized in a naive praos block.
  INFO praos: sim_cli::events: 0 transaction(s) (0 B) did not reach a naive praos block.
  INFO praos: sim_cli::events: Pool 3 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 4 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 37 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 38 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 41 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 42 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 45 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 46 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 50 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 50 published 2 naive praos block(s)
  INFO praos: sim_cli::events: Pool 53 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 54 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 58 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 59 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 62 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 60 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 61 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 67 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 68 published 0 naive praos block(s)
  INFO praos: sim_cli::events: Pool 68 failed to publish 1 naive praos block(s) due to slot battles.
- INFO praos: sim_cli::events: Pool 70 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 70 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 71 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 77 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 93 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 108 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 96 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 102 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 103 failed to publish 1 naive praos block(s) due to slot battles.
  INFO praos: sim_cli::events: Pool 109 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 121 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 132 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 136 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 136 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 137 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 138 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 351 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 362 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 367 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 361 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 371 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 418 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 373 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 376 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 429 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 431 published 2 naive praos block(s)
- INFO praos: sim_cli::events: Pool 442 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 443 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 446 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 477 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 478 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 481 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 510 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 511 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 516 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 518 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 522 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 523 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 527 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 528 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 535 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 536 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 537 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 538 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 539 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 540 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 560 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 547 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 551 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 557 failed to publish 1 naive praos block(s) due to slot battles.
+ INFO praos: sim_cli::events: Pool 560 published 2 naive praos block(s)
  INFO praos: sim_cli::events: Pool 562 published 1 naive praos block(s)
- INFO praos: sim_cli::events: Pool 739 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 741 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 742 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 744 published 1 naive praos block(s)
  INFO praos: sim_cli::events: Pool 745 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 746 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 748 published 1 naive praos block(s)
  INFO leios: sim_cli::events: 0 IB(s) were generated, on average 0.000 IB(s) per slot.
- INFO leios: sim_cli::events: 0 out of 90001 transaction(s) were included in at least one IB.
+ INFO leios: sim_cli::events: 0 out of 60001 transaction(s) were included in at least one IB.
  INFO leios: sim_cli::events: The average age of the pending transactions is NaNs (stddev NaN).
  INFO leios: sim_cli::events: Each transaction was included in an average of NaN IB(s) (stddev NaN).
  INFO leios: sim_cli::events: Each IB contained an average of NaN transaction(s) (stddev NaN) and an average of 0 B (stddev 0 B). 0 IB(s) were empty.
  INFO leios: sim_cli::events: Each node received an average of 0.000 IB(s) (stddev 0.000).
- INFO leios: sim_cli::events: 45 EB(s) were generated; on average there were 0.037 EB(s) per slot.
- INFO leios: sim_cli::events: Each EB contained an average of 5646.622 transaction(s) (stddev 1966.677). 0 EB(s) were empty.
+ INFO leios: sim_cli::events: 34 EB(s) were generated; on average there were 0.028 EB(s) per slot.
+ INFO leios: sim_cli::events: Each EB contained an average of 5259.971 transaction(s) (stddev 2100.479). 0 EB(s) were empty.
  INFO leios: sim_cli::events: Each EB contained an average of 0.000 IB(s) (stddev 0.000). 0 EB(s) were empty.
  INFO leios: sim_cli::events: Each IB was included in an average of NaN EB(s) (stddev NaN).
  INFO leios: sim_cli::events: 0 out of 0 IBs were included in at least one EB.
  INFO leios: sim_cli::events: 0 out of 0 IBs expired before they reached an EB.
- INFO leios: sim_cli::events: 21 out of 45 EBs expired before an EB from their stage reached an RB.
- INFO leios: sim_cli::events: 89941 out of 90001 transaction(s) were included in at least one EB.
- INFO leios: sim_cli::events: 23436 total votes were generated.
- INFO leios: sim_cli::events: Each stake pool produced an average of 108.500 vote(s) (stddev 30.880).
- INFO leios: sim_cli::events: Each EB received an average of 532.636 vote(s) (stddev 144.844).
- INFO leios: sim_cli::events: There were 7826 bundle(s) of votes. Each bundle contained 2.995 vote(s) (stddev 1.626).
- INFO leios: sim_cli::events: 26 L1 block(s) had a Leios endorsement.
- INFO leios: sim_cli::events: 88801 tx(s) (133.20 MB) were referenced by a Leios endorsement.
- INFO leios: sim_cli::events: 1200 tx(s) (1.80 MB) were included directly in a Praos block.
- INFO leios: sim_cli::events: Spatial efficiency: 133.20 MB/8.35 MB (1595.240%) of Leios bytes were unique transactions.
- INFO leios: sim_cli::events: 57448 tx(s) (39.281%) referenced by a Leios endorsement were redundant.
+ INFO leios: sim_cli::events: 18 out of 34 EBs expired before an EB from their stage reached an RB.
+ INFO leios: sim_cli::events: 59941 out of 60001 transaction(s) were included in at least one EB.
+ INFO leios: sim_cli::events: 17226 total votes were generated.
+ INFO leios: sim_cli::events: Each stake pool produced an average of 79.750 vote(s) (stddev 23.322).
+ INFO leios: sim_cli::events: Each EB received an average of 522.000 vote(s) (stddev 165.843).
+ INFO leios: sim_cli::events: There were 5741 bundle(s) of votes. Each bundle contained 3.001 vote(s) (stddev 1.629).
+ INFO leios: sim_cli::events: 18 L1 block(s) had a Leios endorsement.
+ INFO leios: sim_cli::events: 59041 tx(s) (88.56 MB) were referenced by a Leios endorsement.
+ INFO leios: sim_cli::events: 960 tx(s) (1.44 MB) were included directly in a Praos block.
+ INFO leios: sim_cli::events: Spatial efficiency: 88.56 MB/5.88 MB (1507.428%) of Leios bytes were unique transactions.
+ INFO leios: sim_cli::events: 40189 tx(s) (40.501%) referenced by a Leios endorsement were redundant.
  INFO leios: sim_cli::events: Each transaction took an average of NaNs (stddev NaN) to be included in an IB.
- INFO leios: sim_cli::events: Each transaction took an average of 21.108s (stddev 15.890) to be included in an EB.
- INFO leios: sim_cli::events: Each transaction took an average of 58.704s (stddev 19.557) to be included in a block.
- INFO network: sim_cli::events: 67410749 TX message(s) were sent. 67410749 of them were received (100.000%).
+ INFO leios: sim_cli::events: Each transaction took an average of 20.411s (stddev 15.748) to be included in an EB.
+ INFO leios: sim_cli::events: Each transaction took an average of 58.534s (stddev 19.588) to be included in a block.
+ INFO network: sim_cli::events: 44940749 TX message(s) were sent. 44940749 of them were received (100.000%).
  INFO network: sim_cli::events: 0 IB message(s) were sent. 0 of them were received (NaN%).
- INFO network: sim_cli::events: 33249 EB message(s) were sent. 33249 of them were received (100.000%).
- INFO network: sim_cli::events: 5861674 Vote message(s) were sent. 5861674 of them were received (100.000%).
+ INFO network: sim_cli::events: 25010 EB message(s) were sent. 25010 of them were received (100.000%).
+ INFO network: sim_cli::events: 4300009 Vote message(s) were sent. 4300009 of them were received (100.000%).
diff --git a/analysis/sims/regression/experiments/1.3.1/case.csv b/analysis/sims/regression/experiments/1.3.1/case.csv
@@ -0,0 +1,2 @@
+sim-cli,Tx start [s],Tx stop [s],Sim stop [s]
+1.3.1,60,660,1200
diff --git a/analysis/sims/regression/experiments/1.3.1/run.sh b/analysis/sims/regression/experiments/1.3.1/run.sh
@@ -0,0 +1 @@
+../run.sh
diff --git a/analysis/sims/regression/experiments/1.3.1/summary.txt b/analysis/sims/regression/experiments/1.3.1/summary.txt
@@ -0,0 +1,91 @@
+ INFO praos: sim_cli::events: 60001 transactions(s) were generated in total.
+ INFO praos: sim_cli::events: 64 naive praos block(s) were published.
+ INFO praos: sim_cli::events: 1136 slot(s) had no naive praos blocks.
+ INFO praos: sim_cli::events: 60001 transaction(s) (90.00 MB) finalized in a naive praos block.
+ INFO praos: sim_cli::events: 0 transaction(s) (0 B) did not reach a naive praos block.
+ INFO praos: sim_cli::events: Pool 3 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 4 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 38 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 39 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 40 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 41 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 42 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 45 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 46 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 50 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 53 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 54 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 58 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 59 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 67 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 68 failed to publish 1 naive praos block(s) due to slot battles.
+ INFO praos: sim_cli::events: Pool 70 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 94 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 102 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 104 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 105 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 106 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 108 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 109 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 110 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 121 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 122 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 136 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 138 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 351 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 361 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 371 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 429 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 443 published 0 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 443 failed to publish 1 naive praos block(s) due to slot battles.
+ INFO praos: sim_cli::events: Pool 446 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 477 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 478 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 481 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 509 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 510 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 511 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 515 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 518 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 525 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 527 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 537 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 540 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 545 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 556 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 560 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 562 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 567 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 741 published 2 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 742 published 1 naive praos block(s)
+ INFO praos: sim_cli::events: Pool 745 published 1 naive praos block(s)
+ INFO leios: sim_cli::events: 0 IB(s) were generated, on average 0.000 IB(s) per slot.
+ INFO leios: sim_cli::events: 0 out of 60001 transaction(s) were included in at least one IB.
+ INFO leios: sim_cli::events: The average age of the pending transactions is NaNs (stddev NaN).
+ INFO leios: sim_cli::events: Each transaction was included in an average of NaN IB(s) (stddev NaN).
+ INFO leios: sim_cli::events: Each IB contained an average of NaN transaction(s) (stddev NaN) and an average of 0 B (stddev 0 B). 0 IB(s) were empty.
+ INFO leios: sim_cli::events: Each node received an average of 0.000 IB(s) (stddev 0.000).
+ INFO leios: sim_cli::events: 33 EB(s) were generated; on average there were 0.028 EB(s) per slot.
+ INFO leios: sim_cli::events: Each EB contained an average of 3200.576 transaction(s) (stddev 1503.092). 0 EB(s) were empty.
+ INFO leios: sim_cli::events: Each EB contained an average of 0.000 IB(s) (stddev 0.000). 0 EB(s) were empty.
+ INFO leios: sim_cli::events: Each IB was included in an average of NaN EB(s) (stddev NaN).
+ INFO leios: sim_cli::events: 0 out of 0 IBs were included in at least one EB.
+ INFO leios: sim_cli::events: 0 out of 0 IBs expired before they reached an EB.
+ INFO leios: sim_cli::events: 17 out of 33 EBs expired before an EB from their stage reached an RB.
+ INFO leios: sim_cli::events: 59941 out of 60001 transaction(s) were included in at least one EB.
+ INFO leios: sim_cli::events: 17248 total votes were generated.
+ INFO leios: sim_cli::events: Each stake pool produced an average of 79.852 vote(s) (stddev 23.335).
+ INFO leios: sim_cli::events: Each EB received an average of 539.000 vote(s) (stddev 140.491).
+ INFO leios: sim_cli::events: There were 5761 bundle(s) of votes. Each bundle contained 2.994 vote(s) (stddev 1.623).
+ INFO leios: sim_cli::events: 17 L1 block(s) had a Leios endorsement.
+ INFO leios: sim_cli::events: 58981 tx(s) (88.47 MB) were referenced by a Leios endorsement.
+ INFO leios: sim_cli::events: 1020 tx(s) (1.53 MB) were included directly in a Praos block.
+ INFO leios: sim_cli::events: Spatial efficiency: 88.47 MB/3.52 MB (2510.736%) of Leios bytes were unique transactions.
+ INFO leios: sim_cli::events: 0 tx(s) (0.000%) referenced by a Leios endorsement were redundant.
+ INFO leios: sim_cli::events: Each transaction took an average of NaNs (stddev NaN) to be included in an IB.
+ INFO leios: sim_cli::events: Each transaction took an average of 17.169s (stddev 14.321) to be included in an EB.
+ INFO leios: sim_cli::events: Each transaction took an average of 54.879s (stddev 21.092) to be included in a block.
+ INFO network: sim_cli::events: 44940749 TX message(s) were sent. 44940749 of them were received (100.000%).
+ INFO network: sim_cli::events: 0 IB message(s) were sent. 0 of them were received (NaN%).
+ INFO network: sim_cli::events: 24261 EB message(s) were sent. 24261 of them were received (100.000%).
+ INFO network: sim_cli::events: 4314989 Vote message(s) were sent. 4314989 of them were received (100.000%).
diff --git a/analysis/sims/regression/experiments/config.yaml b/analysis/sims/regression/experiments/config.yaml
diff --git a/analysis/sims/regression/experiments/run.sh b/analysis/sims/regression/experiments/run.sh

Original file line number	Diff line number	Diff line change
`@@ -1,3 +1,4 @@`
	`1`	`+experiments/1.3.1/run.sh`
`1`	`2`	`experiments/1.3.0/run.sh`
`2`	`3`	`experiments/1.2.0/run.sh`
`3`	`4`	`experiments/1.1.0/run.sh`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+sim-cli,Tx start [s],Tx stop [s],Sim stop [s]`
	`2`	`+1.3.1,60,660,1200`