|
| 1 | +--- |
| 2 | +title: Weekly Summary – July 14, 2025 |
| 3 | +authors: |
| 4 | +- will |
| 5 | +tags: [progress, update, weekly, validation-analysis, simulation-optimization, trace-processor, linear-leios, stracciatella] |
| 6 | +--- |
| 7 | + |
| 8 | +This week, the Leios team focused on simulation analysis improvements, validation time studies, and comprehensive protocol variant experiments. The team developed new analysis tools, conducted fundamental performance studies of Cardano validation times, and completed extensive mapping of Linear Leios protocol performance under various conditions. |
| 9 | + |
| 10 | +## Analysis tools and infrastructure |
| 11 | + |
| 12 | +### Generic trace analysis framework |
| 13 | + |
| 14 | +- Developed a generic analysis script for processing Leios simulator output |
| 15 | +- Created comprehensive R-based analysis pipeline generating diagnostic plots from `leios-simulation-trace-processor` output |
| 16 | +- Enhanced analysis capabilities for systematic evaluation of simulation results |
| 17 | +- Documentation and usage instructions available in the [trace processor README](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/trace-processor/ReadMe.md). |
| 18 | + |
| 19 | +## Validation performance analysis |
| 20 | + |
| 21 | +### Cardano mainnet validation timing study |
| 22 | + |
| 23 | +- Completed preliminary analysis of block and transaction validation times for Cardano mainnet since Epoch 350 |
| 24 | +- Key findings using `db-analyser` tool: |
| 25 | + - Median transaction signature verification: 0.53 ms/tx |
| 26 | + - Median validation time per kilobyte: 0.29 ms/kB |
| 27 | + - Joint linear model estimate: 0.066 ms/tx plus 0.221 ms/kB |
| 28 | + - Data suitable for bulk estimates but too noisy for individual transaction predictions |
| 29 | +- Identified missing explanatory variables (UTxO set size, input/output counts) extractable from ledger or `cardano-db-sync` |
| 30 | +- Results provide foundation for more accurate simulator validation time modeling |
| 31 | +- Detailed analysis available in the [validation timing notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/timings/preliminary.ipynb). |
| 32 | + |
| 33 | +## Simulation optimization studies |
| 34 | + |
| 35 | +### Timestep resolution analysis |
| 36 | + |
| 37 | +- Conducted comparative study of simulation timestep effects at 1000 TPS Full Leios scenarios |
| 38 | +- Compared 0.100 ms and 0.025 ms time resolutions with no significant differences in results |
| 39 | +- Validated use of coarser timesteps for improved parallelism and reduced simulation runtime |
| 40 | +- Supporting analysis and evidence in the [timestep study notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w27/analysis.ipynb). |
| 41 | + |
| 42 | +## Protocol variant experiments |
| 43 | + |
| 44 | +### Mid-throughput protocol validation |
| 45 | + |
| 46 | +- Completed 100 TPS experiments for Stracciatella and Linear Leios variants using 1400 B/tx over 900 seconds |
| 47 | +- Key findings: |
| 48 | + - 5 slot/stage insufficient for Linear Leios at 100 tx/s |
| 49 | + - Including transactions in EBs causes congestion compared to transaction references |
| 50 | + - 10 MB/EB required for 100 tx/s performance (5 MB/EB insufficient) |
| 51 | + - EB-sortition unluckiness in Stracciatella extends transaction lifecycle but can be mitigated |
| 52 | + - CPU and network peaks occur when transactions are embedded in EBs |
| 53 | +- Analysis artifacts available in [100 TPS experiment documentation](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29b/ReadMe.pdf) and [analysis notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29b/analysis.ipynb). |
| 54 | + |
| 55 | +### Comprehensive Linear Leios performance mapping |
| 56 | + |
| 57 | +- Completed extensive simulation study mapping Linear Leios performance under various loads and configurations |
| 58 | +- Compared multiple Linear Leios variants against Stracciatella baseline |
| 59 | +- Generated comprehensive performance characterizations across different throughput scenarios |
| 60 | +- Results documented in [Linear Leios summary](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/summary.pdf) with variant-specific analysis: |
| 61 | + - [Linear Leios with embedded transactions](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/linear.ipynb) |
| 62 | + - [Linear Leios with transaction references](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/txrefs.ipynb) |
| 63 | + - [Linear Leios without transactions](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/notxs.ipynb) |
| 64 | + - [Stracciatella baseline comparison](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/stracciatella.ipynb). |
| 65 | + |
| 66 | +## Simulation model refinements |
| 67 | + |
| 68 | +- Revised Linear Leios model based on analysis findings, particularly regarding partial EB validation before peer propagation |
| 69 | +- Reimplemented Stracciatella as separate simulation to identify specification deviations |
| 70 | +- Identified and resolved multiple implementation inconsistencies during specification verification process. |
| 71 | + |
| 72 | +## Next steps |
| 73 | + |
| 74 | +- Continue development of analysis infrastructure for systematic protocol evaluation |
| 75 | +- Integrate improved validation timing models into simulation configurations |
| 76 | +- Expand protocol variant testing based on performance mapping results |
| 77 | +- Refine simulation models for enhanced accuracy and specification compliance. |
0 commit comments