Skip to content

Commit 5bbd624

Browse files
bwbushbwbush
authored
Pre-Edinburgh simulation analyses (#282)
* Queries for pre-EDI runs * Network configurations for experiments * Configurations for experiments * Scripts for pre-EDI experiments * Tweaked configuration files * Added config and script files for experiments * Completed analysis of pre-EDI runs * Added read-me
1 parent fec05b5 commit 5bbd624

File tree

998 files changed

+33547
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

998 files changed

+33547
-0
lines changed

‎analysis/sims/2025w13/ReadMe.md‎

Lines changed: 115 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,115 @@
1+
# Simulation experiments at tag `leios-2025w12`
2+
3+
## Workflow for running experiments
4+
5+
1. Copy the Haskell and Rust executables to this folder.
6+
2. Edit [env.sh](env.sh) to set the MongoDB host and database names.
7+
3. Execute [run-experiment.sh](run-experiment.sh).
8+
4. Execute [run-queries.sh](run-queries.sh).
9+
5. Optionally execute [export-results.sh](export-results.sh) to create CSV files.
10+
6. Execute `nix run ..` to launch a Jupyter server.
11+
7. Run Jupyter notebook [analysis.ipynb](analysis.ipynb).
12+
13+
## Archive of results
14+
15+
| Results | 100-node network | Realistic network |
16+
|---------------------|-----------------------------------------------------------------------------|-----------------------------------------------------------------------------|
17+
| CPU usage | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/cpus.csv.gz | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/cpus.csv.gz |
18+
| IB generation | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/ibgen.csv.gz | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/ibgen.csv.gz |
19+
| EB generation | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/ebgen.csv.gz | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/ebgen.csv.gz |
20+
| RB generation | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/rbgen.csv.gz | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/rbgen.csv.gz |
21+
| Receipt of messages | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/receipts.csv.gz | https://leios-sim-output.s3.us-east-1.amazonaws.com/2025w13/receipts.csv.gz |
22+
23+
24+
### Data dictionary
25+
26+
#### CPU usage
27+
28+
29+
| Field | Units | Type | Description |
30+
|---------------------------|-------|----------|-----------------------------------------------------------------------------------------------|
31+
| simulator | - | scenario | The name of the simulator used to run the experiment. |
32+
| label | - | scenario | A string describing the experiment, in this case `default`. |
33+
| network | - | scenario | A string describing the network, in this case `100 ` since the 100-node test network is used. |
34+
| ib-body-avg-size-bytes | B | scenario | The size of the IBs. |
35+
| ib-generation-probability | #/s | scenario | The rate of IB generation. |
36+
| leios-stage-length-slots | s | scenario | The length of each pipeline stage. |
37+
| slot | s | output | The slot number in which the task was completed. |
38+
| node | - | output | The unique identifier for the node that performed the task. |
39+
| task | - | output | The name of the task performed. |
40+
| duration | s | output | CPU time spent on the task. |
41+
42+
43+
#### IB generation
44+
45+
| Field | Units | Type | Description |
46+
|---------------------------|-------|----------|-----------------------------------------------------------------------------------------------|
47+
| simulator | - | scenario | The name of the simulator used to run the experiment. |
48+
| label | - | scenario | A string describing the experiment, in this case `default`. |
49+
| network | - | scenario | A string describing the network, in this case `100 ` since the 100-node test network is used. |
50+
| ib-body-avg-size-bytes | B | scenario | The size of the IBs. |
51+
| ib-generation-probability | #/s | scenario | The rate of IB generation. |
52+
| leios-stage-length-slots | s | scenario | The length of each pipeline stage. |
53+
| time | s | output | The time when the IB was generated. |
54+
| node | - | output | The unique identifier for the node that generated the IB. |
55+
| ib | - | output | The unique identifier for the IB. |
56+
| size | B | output | The size of the IB. |
57+
| eb-count | # | output | The number of EBs referencing the IB. |
58+
| eb-first | s | output | The time when the IB was first referenced by an EB. |
59+
| eb-last | s | output | The time when the IB was last referenced by an EB. |
60+
61+
62+
#### EB generation
63+
64+
| Field | Units | Type | Description |
65+
|---------------------------|-------|----------|-----------------------------------------------------------------------------------------------|
66+
| simulator | - | scenario | The name of the simulator used to run the experiment. |
67+
| label | - | scenario | A string describing the experiment, in this case `default`. |
68+
| network | - | scenario | A string describing the network, in this case `100 ` since the 100-node test network is used. |
69+
| ib-body-avg-size-bytes | B | scenario | The size of the IBs. |
70+
| ib-generation-probability | #/s | scenario | The rate of IB generation. |
71+
| leios-stage-length-slots | s | scenario | The length of each pipeline stage. |
72+
| time | s | output | The time when the EB was generated. |
73+
| node | - | output | The unique identifier for the node that generated the EB. |
74+
| eb | - | output | The unique identifier for the EB. |
75+
| size | B | output | The size of the EB. |
76+
| ib-count | # | output | The number of IBs referenced by the EB. |
77+
| rb-count | # | output | The number of RBs referencing the EB via a certificate. |
78+
| rb-first | s | output | The time when the EB was first referenced by an RB. |
79+
| rb-last | s | output | The time when the EB was last referenced by an RB. |
80+
81+
82+
#### RB generation
83+
84+
| Field | Units | Type | Description |
85+
|---------------------------|-------|----------|-----------------------------------------------------------------------------------------------|
86+
| simulator | - | scenario | The name of the simulator used to run the experiment. |
87+
| label | - | scenario | A string describing the experiment, in this case `default`. |
88+
| network | - | scenario | A string describing the network, in this case `100 ` since the 100-node test network is used. |
89+
| ib-body-avg-size-bytes | B | scenario | The size of the IBs. |
90+
| ib-generation-probability | #/s | scenario | The rate of IB generation. |
91+
| leios-stage-length-slots | s | scenario | The length of each pipeline stage. |
92+
| time | s | output | The time when the RB was generated. |
93+
| node | - | output | The unique identifier for the node that generated the RB. |
94+
| rb | - | output | The unique identifier for the RB. |
95+
| size | B | output | The size of the RB. |
96+
| eb-count | # | output | The number of EBs referenced by the RB. |
97+
98+
99+
### Receipt of messages
100+
101+
| Field | Units | Type | Description |
102+
|---------------------------|-------|----------|-----------------------------------------------------------------------------------------------|
103+
| simulator | - | scenario | The name of the simulator used to run the experiment. |
104+
| label | - | scenario | A string describing the experiment, in this case `default`. |
105+
| network | - | scenario | A string describing the network, in this case `100 ` since the 100-node test network is used. |
106+
| ib-body-avg-size-bytes | B | scenario | The size of the IBs. |
107+
| ib-generation-probability | #/s | scenario | The rate of IB generation. |
108+
| leios-stage-length-slots | s | scenario | The length of each pipeline stage. |
109+
| kind | - | output | The kind of item: `IB`, `EB`, `RB`, or `VT`. |
110+
| item | - | output | The unique identifier for the item. |
111+
| producer | - | output | The unique identifier for the node that generated the item. |
112+
| sent | s | output | The time when the item was originally sent from the producer. |
113+
| recipient | - | output | The unique identifier for the node that received the item. |
114+
| received | s | output | The time when the item was received. |
115+
| elapsed | s | output | The time elapsed between when the item was originally sent by the producer and then received. |

0 commit comments

Comments
 (0)