Skip to content

Commit d0756c6

Browse files
committed
site(news): weekly update
1 parent 891a195 commit d0756c6

File tree

3 files changed

+152
-0
lines changed

3 files changed

+152
-0
lines changed

Logbook.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,12 @@
22

33
## 2025-07-25
44

5+
## CIP
6+
7+
- completed review of protocol overview, components flow and parameters
8+
- completed integration of votes and certificates specification
9+
- drafted node behehavior & network (mini protocols)
10+
511
### SN on throughput metrics
612

713
I want to propose a change in our terminology:
Lines changed: 77 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,77 @@
1+
---
2+
title: Weekly Summary – July 14, 2025
3+
authors:
4+
- will
5+
tags: [progress, update, weekly, validation-analysis, simulation-optimization, trace-processor, linear-leios, stracciatella]
6+
---
7+
8+
This week, the Leios team focused on simulation analysis improvements, validation time studies, and comprehensive protocol variant experiments. The team developed new analysis tools, conducted fundamental performance studies of Cardano validation times, and completed extensive mapping of Linear Leios protocol performance under various conditions.
9+
10+
## Analysis tools and infrastructure
11+
12+
### Generic trace analysis framework
13+
14+
- Developed a generic analysis script for processing Leios simulator output
15+
- Created comprehensive R-based analysis pipeline generating diagnostic plots from `leios-simulation-trace-processor` output
16+
- Enhanced analysis capabilities for systematic evaluation of simulation results
17+
- Documentation and usage instructions available in the [trace processor README](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/trace-processor/ReadMe.md).
18+
19+
## Validation performance analysis
20+
21+
### Cardano mainnet validation timing study
22+
23+
- Completed preliminary analysis of block and transaction validation times for Cardano mainnet since Epoch 350
24+
- Key findings using `db-analyser` tool:
25+
- Median transaction signature verification: 0.53 ms/tx
26+
- Median validation time per kilobyte: 0.29 ms/kB
27+
- Joint linear model estimate: 0.066 ms/tx plus 0.221 ms/kB
28+
- Data suitable for bulk estimates but too noisy for individual transaction predictions
29+
- Identified missing explanatory variables (UTxO set size, input/output counts) extractable from ledger or `cardano-db-sync`
30+
- Results provide foundation for more accurate simulator validation time modeling
31+
- Detailed analysis available in the [validation timing notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/timings/preliminary.ipynb).
32+
33+
## Simulation optimization studies
34+
35+
### Timestep resolution analysis
36+
37+
- Conducted comparative study of simulation timestep effects at 1000 TPS Full Leios scenarios
38+
- Compared 0.100 ms and 0.025 ms time resolutions with no significant differences in results
39+
- Validated use of coarser timesteps for improved parallelism and reduced simulation runtime
40+
- Supporting analysis and evidence in the [timestep study notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w27/analysis.ipynb).
41+
42+
## Protocol variant experiments
43+
44+
### Mid-throughput protocol validation
45+
46+
- Completed 100 TPS experiments for Stracciatella and Linear Leios variants using 1400 B/tx over 900 seconds
47+
- Key findings:
48+
- 5 slot/stage insufficient for Linear Leios at 100 tx/s
49+
- Including transactions in EBs causes congestion compared to transaction references
50+
- 10 MB/EB required for 100 tx/s performance (5 MB/EB insufficient)
51+
- EB-sortition unluckiness in Stracciatella extends transaction lifecycle but can be mitigated
52+
- CPU and network peaks occur when transactions are embedded in EBs
53+
- Analysis artifacts available in [100 TPS experiment documentation](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29b/ReadMe.pdf) and [analysis notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29b/analysis.ipynb).
54+
55+
### Comprehensive Linear Leios performance mapping
56+
57+
- Completed extensive simulation study mapping Linear Leios performance under various loads and configurations
58+
- Compared multiple Linear Leios variants against Stracciatella baseline
59+
- Generated comprehensive performance characterizations across different throughput scenarios
60+
- Results documented in [Linear Leios summary](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/summary.pdf) with variant-specific analysis:
61+
- [Linear Leios with embedded transactions](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/linear.ipynb)
62+
- [Linear Leios with transaction references](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/txrefs.ipynb)
63+
- [Linear Leios without transactions](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/notxs.ipynb)
64+
- [Stracciatella baseline comparison](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w29/stracciatella.ipynb).
65+
66+
## Simulation model refinements
67+
68+
- Revised Linear Leios model based on analysis findings, particularly regarding partial EB validation before peer propagation
69+
- Reimplemented Stracciatella as separate simulation to identify specification deviations
70+
- Identified and resolved multiple implementation inconsistencies during specification verification process.
71+
72+
## Next steps
73+
74+
- Continue development of analysis infrastructure for systematic protocol evaluation
75+
- Integrate improved validation timing models into simulation configurations
76+
- Expand protocol variant testing based on performance mapping results
77+
- Refine simulation models for enhanced accuracy and specification compliance.
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
title: Weekly Summary – July 21, 2025
3+
authors:
4+
- will
5+
tags: [progress, update, weekly, cip-development, throughput-metrics, validation-analysis, high-throughput-validation, simulation-documentation]
6+
---
7+
8+
This week, the Leios team made significant progress on CIP development, refined validation timing analysis with improved methodologies, and achieved high-throughput validation milestones. The team completed major CIP specification components, proposed improved throughput metrics for better comparability, and demonstrated 1000 TPS capability with specific protocol variants.
9+
10+
## CIP development progress
11+
12+
### Protocol specification completion
13+
14+
- Completed comprehensive review of protocol overview, components flow, and parameters
15+
- Integrated votes and certificates specification into the CIP documentation
16+
- Drafted node behavior and network specifications, including mini-protocol definitions
17+
- Advanced CIP towards completion with core protocol components fully specified.
18+
19+
## Throughput metrics standardization
20+
21+
### Improved measurement methodology
22+
23+
- Proposed transition from transaction-per-second (Tx/s) to transaction-bytes-per-second (TxB/s) metrics for enhanced comparability
24+
- Recommended using Tx/s only in introductory statements with transaction size context (e.g., "100 Tx/s with 1400 B transactions")
25+
- Established TxkB/s and TxMB/s as primary throughput metrics for analysis
26+
- Benefits include:
27+
- Direct comparability across different transaction sizes
28+
- Clear nominal storage and network demand calculations
29+
- Example: 100 Tx/s with 1400 B transactions = 140 TxkB/s = ~12 GB/day storage
30+
- Network overhead calculation: 140 TxkB/s × 10 peers = 11.2 Mb/s.
31+
32+
## Enhanced validation analysis
33+
34+
### Revised Cardano validation timing study
35+
36+
- Completed refined analysis of Cardano mainnet validation times using clean dataset on idle machine
37+
- Significantly improved accuracy over preliminary results by eliminating CPU contention effects
38+
- Updated findings for transaction signature verification and Plutus script execution:
39+
- Median times: 428.4 μs/tx and 211.5 μs/kB
40+
- Linear model: 148.1 μs/tx plus 114.1 μs/kB
41+
- Enhanced model: 137.5 μs/tx plus 60.2 μs/kB plus 585.2 μs/Gstep with Laplace error distribution
42+
- Results suitable for bulk block estimates despite individual transaction prediction limitations
43+
- Findings support reducing CPU-timing parameters in default Leios simulation configurations
44+
- Comprehensive analysis available in the [validation timing documentation](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/timings/ReadMe.ipynb).
45+
46+
## High-throughput protocol validation
47+
48+
### 1000 TPS Linear Leios demonstration
49+
50+
- Successfully demonstrated Linear Leios with transaction references supporting 1000 tx/s at 300 B/tx
51+
- Validated Stracciatella variant capability at 1000 TPS throughput levels
52+
- Confirmed that Linear Leios with embedded transactions cannot sustain such throughput
53+
- Results provide clear protocol variant performance boundaries for high-throughput scenarios
54+
- Detailed evidence and analysis in the [1000 TPS study notebook](https://github.com/input-output-hk/ouroboros-leios/blob/main/analysis/sims/2025w30/analysis.ipynb).
55+
56+
## Simulation infrastructure improvements
57+
58+
### Rust simulation documentation
59+
60+
- Enhanced documentation of current Rust simulation implementation
61+
- Documented available protocol variants and their implementation status
62+
- Improved accessibility and usability of simulation framework for protocol development.
63+
64+
## Next steps
65+
66+
- Finalize CIP documentation for community review and feedback
67+
- Implement standardized throughput metrics across analysis frameworks
68+
- Apply revised validation timing parameters to simulation configurations
69+
- Expand high-throughput testing to additional protocol variants and scenarios.

0 commit comments

Comments
 (0)