Experiments on Leios variants at tag leios-2025w26 (#429)

* Designed variants experiment
* Updated trace processor to handle the no-IB variant
* Analyzed variants experiment
* Updated logbook

Author: bwbush

Logbook.md

@@ -1,5 +1,40 @@
 # Leios logbook
 
+## 2025-06-27
+
+### Simulation analysis of nine candidate variants of Leios
+
+This new set of simulations examined three basic variants and three sharding strategies.
+
+- Basic
+    - Full 
+    - Full without IBs
+    - Full with transaction references
+- Sharding
+    - Unsharded
+    - Sharded
+    - Overcollateralized 1x (i.e., each tx has a probability of being included in two shards instead of one)
+
+The network and CPU metrics for all of the variants were acceptable, but they had different spatial and temporal efficiencies.
+
+| Variant                 | Sharding              | Spatial Efficiency | Time to Ledger |
+|-------------------------|-----------------------|-------------------:|---------------:|
+| full                    | unsharded             |            52.307% |        64.404s |
+| full                    | sharded               |            92.043% |       137.362s | 
+| full                    | overcollateralized 1x |            89.097% |        94.155s |
+| full without IBs        | unsharded             |            79.050% |        43.057s |
+| full without IBs        | sharded               |            79.052% |        43.052s |
+| full without IBs        | overcollateralized 1x |            79.053% |        43.053s |
+| full with-tx references | unsharded             |            95.999% |        63.763s |
+| full with-tx references | sharded               |            96.466% |       137.324s |
+| full with-tx references | overcollateralized 1x |            96.413% |        94.112s |
+
+See [analysis/sims/2025w26/analysis-variants-sharding.ipynb](analysis/sims/2025w26/analysis-variants-sharding.ipynb) for full details.
+
+![Spatial efficiency of nine Leios variants](analysis/sims/2025w26/plots/vars/spatial-efficiency.svg)
+
+![Temporal efficiency of nine Leios variants](analysis/sims/2025w26/plots/vars/reach-rb-tx.svg)
+
 ## 2025-06-24
 
 ### Conflict experiment on simplest Leios variant

analysis/sims/2025w26/ReadMe.md

@@ -0,0 +1,4 @@
+# Analyses at tag `leios-2025w26`
+
+- Simplest variant of Leios: [analysis-simple-conflicts.ipynb](analysis-simple-conflicts.ipynb)
+- Nine proposed variants of Leios: [analysis-variants-sharding.ipynb](analysis-variants-sharding.ipynb)

analysis/sims/2025w26/analysis.ipynb renamed to analysis/sims/2025w26/analysis-simple-conflicts.ipynb

@@ -3,10 +3,9 @@
 
 set -e
 
-mkdir -p results/cxs
-
-for d in cxs
+for d in vars
 do
+  mkdir -p results/$d
   for f in cpus lifecycle resources receipts
   do
     DIR=$(find $d -type f -name $f.csv.gz \( -not -empty \) -printf %h\\n -quit)

analysis/sims/2025w26/analysis-variants-sharding.ipynb

@@ -0,0 +1,10 @@
+#!/usr/bin/env bash
+
+sed -e 's/Label/Variant,Sharding/' \
+    -e 's/full-/full,/' \
+    -e 's/noib-/full-without-ibs,/' \
+    -e 's/txrf-/full-with-tx-references,/' \
+    -e 's/shard/sharded/' \
+    -e 's/simpl/unsharded/' \
+    -e 's/overc/overcollateralized-1/' \
+    -i vars/*/case.csv

analysis/sims/2025w26/combine-results.sh

@@ -0,0 +1,2 @@
+Simulator,Variant,Sharding
+Rust,full,overcollateralized-1