Skip to content

Commit a79ce0f

Browse files
authored
Merge pull request #3422 from demergent-labs/benchmark--0.33.0
Benchmark Results for benchmark--0.33.0
2 parents cb69503 + 03df3b9 commit a79ce0f

File tree

223 files changed

+8954
-11168
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

223 files changed

+8954
-11168
lines changed

benchmarks.json

Lines changed: 21 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -158,5 +158,25 @@
158158
"max": 18333390745,
159159
"baselineWeightedEfficiencyScore": 116049828.68333332
160160
}
161+
},
162+
"0.33.0": {
163+
"stable": {
164+
"count": 1083,
165+
"mean": 314907220.6518929,
166+
"median": 1246413,
167+
"standardDeviation": 1802331190.8616369,
168+
"min": 99703,
169+
"max": 28099594610,
170+
"baselineWeightedEfficiencyScore": 31924467.76518929
171+
},
172+
"experimental": {
173+
"count": 59,
174+
"mean": 1801505845.2711864,
175+
"median": 170862049,
176+
"standardDeviation": 4033571519.948209,
177+
"min": 1418948,
178+
"max": 18595403563,
179+
"baselineWeightedEfficiencyScore": 232260568.02711865
180+
}
161181
}
162-
}
182+
}

benchmarks.md

Lines changed: 95 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,8 @@
1+
<!--
2+
This file is auto-generated by .github/scripts/analyze_benchmarks/markdown.ts
3+
Do not edit this file manually. Changes will be overwritten.
4+
-->
5+
16
# Benchmarks
27

38
## Purpose and Usage
@@ -6,6 +11,93 @@ This document tracks high-level performance changes across Azle versions for com
611

712
**For detailed benchmarks showing how different Candid data types perform, see the [benchmarks example](examples/stable/test/end_to_end/candid_rpc/benchmarks/benchmarks.md).** This is the best resource for understanding day-to-day performance in your Azle applications.
813

14+
## Version `0.33.0`
15+
16+
<table>
17+
<tr>
18+
<th></th>
19+
<th colspan="2">Stable</th>
20+
<th colspan="2">Experimental</th>
21+
</tr>
22+
<tr>
23+
<th>Metric</th>
24+
<th>Score</th>
25+
<th>Change</th>
26+
<th>Score</th>
27+
<th>Change</th>
28+
</tr>
29+
<tr>
30+
<td>Baseline Weighted Efficiency</td>
31+
<td>31_924_467</td>
32+
<td><span style="color: red">155.24%</span></td>
33+
<td>232_260_568</td>
34+
<td><span style="color: red">100.14%</span></td>
35+
</tr>
36+
<tr>
37+
<td colspan="5">&nbsp;</td>
38+
</tr>
39+
<tr>
40+
<th></th>
41+
<th>Count</th>
42+
<th></th>
43+
<th>Count</th>
44+
<th></th>
45+
</tr>
46+
<tr>
47+
<td>Method Executions</td>
48+
<td>1083</td>
49+
<td><span style="color: red">63.10%</span></td>
50+
<td>59</td>
51+
<td><span style="color: green">-92.93%</span></td>
52+
</tr>
53+
<tr>
54+
<td colspan="5">&nbsp;</td>
55+
</tr>
56+
<tr>
57+
<th></th>
58+
<th>Number of Instructions</th>
59+
<th></th>
60+
<th>Number of Instructions</th>
61+
<th></th>
62+
</tr>
63+
<tr>
64+
<td>Mean</td>
65+
<td>314_907_220</td>
66+
<td><span style="color: red">158.44%</span></td>
67+
<td>1_801_505_845</td>
68+
<td><span style="color: red">57.34%</span></td>
69+
</tr>
70+
<tr>
71+
<td>Median</td>
72+
<td>1_246_413</td>
73+
<td><span style="color: red">42.34%</span></td>
74+
<td>170_862_049</td>
75+
<td><span style="color: red">3303.46%</span></td>
76+
</tr>
77+
<tr>
78+
<td>Standard Deviation</td>
79+
<td>1_802_331_190</td>
80+
<td><span style="color: red">36.88%</span></td>
81+
<td>4_033_571_519</td>
82+
<td><span style="color: red">32.11%</span></td>
83+
</tr>
84+
<tr>
85+
<td>Min</td>
86+
<td>99_703</td>
87+
<td><span style="color: red">0.20%</span></td>
88+
<td>1_418_948</td>
89+
<td><span style="color: red">1751.90%</span></td>
90+
</tr>
91+
<tr>
92+
<td>Max</td>
93+
<td>28_099_594_610</td>
94+
<td><span style="color: red">34.67%</span></td>
95+
<td>18_595_403_563</td>
96+
<td><span style="color: red">1.43%</span></td>
97+
</tr>
98+
99+
</table>
100+
9101
## Version `0.30.0`
10102

11103
<table>
@@ -702,6 +794,8 @@ This document tracks high-level performance changes across Azle versions for com
702794

703795
</table>
704796

797+
798+
705799
---
706800

707-
_Report generated automatically by Azle_
801+
_Report generated automatically by Azle_

0 commit comments

Comments
 (0)