Skip to content

Commit 0d510a1

Browse files
github-actions[bot]github-actions[bot]
authored
run benchmarks
1 parent 53e22c0 commit 0d510a1

File tree

221 files changed

+8838
-11166
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

221 files changed

+8838
-11166
lines changed

‎examples/experimental/demo/basic_bitcoin/benchmarks.json‎

Lines changed: 109 additions & 202 deletions
Large diffs are not rendered by default.

‎examples/experimental/demo/basic_bitcoin/benchmarks.md‎

Lines changed: 55 additions & 57 deletions
Original file line numberDiff line numberDiff line change
@@ -1,68 +1,66 @@
11
# Benchmarks for basic_bitcoin
22

3-
## Current benchmarks Azle version: 0.32.0
3+
## Current benchmarks Azle version: 0.33.0
4+
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls | Change |
5+
|-----------|-------------|------------|--------|-----|--------------|-------|
6+
| 0 | 1 | 170_905_250 | 175_905_250 | $0.0002409902 | $240.99 | <font color="green">-7_629_006_953</font> |
7+
| 1 | 1 | 170_800_513 | 175_800_513 | $0.0002408467 | $240.84 | <font color="green">-2_578_218</font> |
8+
| 2 | 1 | 171_428_639 | 176_428_639 | $0.0002417072 | $241.70 | <font color="green">-1_979_316</font> |
9+
| 3 | 1 | 171_025_523 | 176_025_523 | $0.0002411550 | $241.15 | <font color="green">-2_900_672</font> |
10+
| 4 | 1 | 170_961_289 | 175_961_289 | $0.0002410670 | $241.06 | <font color="green">-2_370_795</font> |
11+
| 5 | 1 | 171_466_412 | 176_466_412 | $0.0002417590 | $241.75 | <font color="green">-1_679_422</font> |
12+
| 6 | 1 | 170_862_049 | 175_862_049 | $0.0002409310 | $240.93 | <font color="green">-2_947_755</font> |
13+
| 7 | 1 | 173_307_359 | 178_307_359 | $0.0002442811 | $244.28 | <font color="green">-18_417</font> |
14+
| 8 | 1 | 169_834_121 | 174_834_121 | $0.0002395227 | $239.52 | <font color="green">-5_819_179</font> |
15+
| 9 | 1 | 171_501_922 | 176_501_922 | $0.0002418076 | $241.80 | <font color="green">-550_948</font> |
16+
| 10 | 1 | 178_529_015 | 183_529_015 | $0.0002514348 | $251.43 | <font color="red">+4_749_094</font> |
17+
| 11 | 1 | 171_776_225 | 176_776_225 | $0.0002421834 | $242.18 | <font color="green">-8_909_712</font> |
18+
| 12 | 1 | 171_335_289 | 176_335_289 | $0.0002415793 | $241.57 | <font color="green">-2_359_824</font> |
19+
| 13 | 1 | 171_608_402 | 176_608_402 | $0.0002419535 | $241.95 | <font color="green">-1_749_552</font> |
20+
| 14 | 1 | 170_037_035 | 175_037_035 | $0.0002398007 | $239.80 | <font color="green">-3_798_922</font> |
21+
| 15 | 1 | 172_414_397 | 177_414_397 | $0.0002430577 | $243.05 | <font color="red">+254_264</font> |
22+
| 16 | 1 | 171_497_780 | 176_497_780 | $0.0002418020 | $241.80 | <font color="green">-38_763_946</font> |
23+
| 17 | 1 | 171_159_191 | 176_159_191 | $0.0002413381 | $241.33 | <font color="green">-2_757_057</font> |
24+
| 18 | 1 | 171_637_667 | 176_637_667 | $0.0002419936 | $241.99 | <font color="green">-1_835_839</font> |
25+
| 19 | 1 | 169_942_027 | 174_942_027 | $0.0002396706 | $239.67 | <font color="green">-4_067_254</font> |
26+
| 20 | 1 | 170_006_935 | 175_006_935 | $0.0002397595 | $239.75 | <font color="green">-2_107_623</font> |
427

5-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls | Change |
6-
| --- | ------------------- | ------------- | ------------- | ------------- | ----------------- | --------------------------------------- |
7-
| 0 | init | 7_799_912_203 | 5_920_554_881 | $0.0078723842 | $7_872.38 | <font color="green">-193_524_294</font> |
8-
| 1 | http_request_update | 173_378_731 | 69_941_492 | $0.0000929991 | $92.99 | <font color="red">+416_751</font> |
9-
| 2 | http_request_update | 173_407_955 | 69_953_182 | $0.0000930146 | $93.01 | <font color="red">+513_841</font> |
10-
| 3 | http_request_update | 173_926_195 | 70_160_478 | $0.0000932903 | $93.29 | <font color="red">+619_262</font> |
11-
| 4 | http_request_update | 173_332_084 | 69_922_833 | $0.0000929743 | $92.97 | <font color="red">+294_134</font> |
12-
| 5 | http_request_update | 173_145_834 | 69_848_333 | $0.0000928752 | $92.87 | <font color="red">+218_590</font> |
13-
| 6 | http_request_update | 173_809_804 | 70_113_921 | $0.0000932284 | $93.22 | <font color="red">+548_517</font> |
14-
| 7 | http_request_update | 173_325_776 | 69_920_310 | $0.0000929709 | $92.97 | <font color="red">+274_361</font> |
15-
| 8 | http_request_update | 175_653_300 | 70_851_320 | $0.0000942089 | $94.20 | <font color="red">+297_412</font> |
16-
| 9 | http_request_update | 172_052_870 | 69_411_148 | $0.0000922939 | $92.29 | <font color="red">+270_927</font> |
17-
| 10 | http_request_update | 173_779_921 | 70_101_968 | $0.0000932125 | $93.21 | <font color="red">+333_798</font> |
18-
| 11 | http_request_update | 180_685_937 | 72_864_374 | $0.0000968856 | $96.88 | <font color="red">+340_884</font> |
19-
| 12 | http_request_update | 173_695_113 | 70_068_045 | $0.0000931674 | $93.16 | <font color="red">+283_477</font> |
20-
| 13 | http_request_update | 173_357_954 | 69_933_181 | $0.0000929881 | $92.98 | <font color="red">+309_624</font> |
21-
| 14 | http_request_update | 173_835_957 | 70_124_382 | $0.0000932423 | $93.24 | <font color="red">+328_606</font> |
22-
| 15 | http_request_update | 172_160_133 | 69_454_053 | $0.0000923510 | $92.35 | <font color="red">+490_704</font> |
23-
| 16 | http_request_update | 210_261_726 | 84_694_690 | $0.0001126160 | $112.61 | <font color="red">+36_398_388</font> |
24-
| 17 | http_request_update | 173_916_248 | 70_156_499 | $0.0000932850 | $93.28 | <font color="red">+392_003</font> |
25-
| 18 | http_request_update | 173_473_506 | 69_979_402 | $0.0000930495 | $93.04 | <font color="red">+338_003</font> |
26-
| 19 | http_request_update | 174_009_281 | 70_193_712 | $0.0000933345 | $93.33 | <font color="red">+357_541</font> |
27-
| 20 | http_request_update | 172_114_558 | 69_435_823 | $0.0000923267 | $92.32 | <font color="red">+310_170</font> |
28-
| 21 | http_request_update | 172_083_551 | 69_423_420 | $0.0000923102 | $92.31 | <font color="red">+278_533</font> |
28+
## Baseline benchmarks Azle version: 0.32.0
29+
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
30+
|-----------|-------------|------------|--------|-----|--------------|
31+
| 0 | init | 7_799_912_203 | 7_804_912_203 | $0.0106927297 | $10_692.72 |
32+
| 1 | http_request_update | 173_378_731 | 178_378_731 | $0.0002443789 | $244.37 |
33+
| 2 | http_request_update | 173_407_955 | 178_407_955 | $0.0002444189 | $244.41 |
34+
| 3 | http_request_update | 173_926_195 | 178_926_195 | $0.0002451289 | $245.12 |
35+
| 4 | http_request_update | 173_332_084 | 178_332_084 | $0.0002443150 | $244.31 |
36+
| 5 | http_request_update | 173_145_834 | 178_145_834 | $0.0002440598 | $244.05 |
37+
| 6 | http_request_update | 173_809_804 | 178_809_804 | $0.0002449694 | $244.96 |
38+
| 7 | http_request_update | 173_325_776 | 178_325_776 | $0.0002443063 | $244.30 |
39+
| 8 | http_request_update | 175_653_300 | 180_653_300 | $0.0002474950 | $247.49 |
40+
| 9 | http_request_update | 172_052_870 | 177_052_870 | $0.0002425624 | $242.56 |
41+
| 10 | http_request_update | 173_779_921 | 178_779_921 | $0.0002449285 | $244.92 |
42+
| 11 | http_request_update | 180_685_937 | 185_685_937 | $0.0002543897 | $254.38 |
43+
| 12 | http_request_update | 173_695_113 | 178_695_113 | $0.0002448123 | $244.81 |
44+
| 13 | http_request_update | 173_357_954 | 178_357_954 | $0.0002443504 | $244.35 |
45+
| 14 | http_request_update | 173_835_957 | 178_835_957 | $0.0002450053 | $245.00 |
46+
| 15 | http_request_update | 172_160_133 | 177_160_133 | $0.0002427094 | $242.70 |
47+
| 16 | http_request_update | 210_261_726 | 215_261_726 | $0.0002949086 | $294.90 |
48+
| 17 | http_request_update | 173_916_248 | 178_916_248 | $0.0002451153 | $245.11 |
49+
| 18 | http_request_update | 173_473_506 | 178_473_506 | $0.0002445087 | $244.50 |
50+
| 19 | http_request_update | 174_009_281 | 179_009_281 | $0.0002452427 | $245.24 |
51+
| 20 | http_request_update | 172_114_558 | 177_114_558 | $0.0002426469 | $242.64 |
52+
| 21 | http_request_update | 172_083_551 | 177_083_551 | $0.0002426045 | $242.60 |
2953

30-
## Baseline benchmarks Azle version: 0.30.0
3154

32-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
33-
| --- | ------------------- | ------------- | ------------- | ------------- | ----------------- |
34-
| 0 | init | 7_993_436_497 | 5_997_964_598 | $0.0079753136 | $7_975.31 |
35-
| 1 | http_request_update | 172_961_980 | 69_774_792 | $0.0000927774 | $92.77 |
36-
| 2 | http_request_update | 172_894_114 | 69_747_645 | $0.0000927414 | $92.74 |
37-
| 3 | http_request_update | 173_306_933 | 69_912_773 | $0.0000929609 | $92.96 |
38-
| 4 | http_request_update | 173_037_950 | 69_805_180 | $0.0000928179 | $92.81 |
39-
| 5 | http_request_update | 172_927_244 | 69_760_897 | $0.0000927590 | $92.75 |
40-
| 6 | http_request_update | 173_261_287 | 69_894_514 | $0.0000929366 | $92.93 |
41-
| 7 | http_request_update | 173_051_415 | 69_810_566 | $0.0000928250 | $92.82 |
42-
| 8 | http_request_update | 175_355_888 | 70_732_355 | $0.0000940507 | $94.05 |
43-
| 9 | http_request_update | 171_781_943 | 69_302_777 | $0.0000921498 | $92.14 |
44-
| 10 | http_request_update | 173_446_123 | 69_968_449 | $0.0000930349 | $93.03 |
45-
| 11 | http_request_update | 180_345_053 | 72_728_021 | $0.0000967043 | $96.70 |
46-
| 12 | http_request_update | 173_411_636 | 69_954_654 | $0.0000930166 | $93.01 |
47-
| 13 | http_request_update | 173_048_330 | 69_809_332 | $0.0000928234 | $92.82 |
48-
| 14 | http_request_update | 173_507_351 | 69_992_940 | $0.0000930675 | $93.06 |
49-
| 15 | http_request_update | 171_669_429 | 69_257_771 | $0.0000920900 | $92.08 |
50-
| 16 | http_request_update | 173_863_338 | 70_135_335 | $0.0000932569 | $93.25 |
51-
| 17 | http_request_update | 173_524_245 | 69_999_698 | $0.0000930765 | $93.07 |
52-
| 18 | http_request_update | 173_135_503 | 69_844_201 | $0.0000928697 | $92.86 |
53-
| 19 | http_request_update | 173_651_740 | 70_050_696 | $0.0000931443 | $93.14 |
54-
| 20 | http_request_update | 171_804_388 | 69_311_755 | $0.0000921618 | $92.16 |
55-
| 21 | http_request_update | 171_805_018 | 69_312_007 | $0.0000921621 | $92.16 |
5655

5756
---
5857

5958
**Note on calculations:**
60-
61-
- Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
62-
- base_fee: 590_000 cycles
63-
- per_instruction_fee: 0.4 cycles
64-
- additional_fee_per_billion: 400_000_000 cycles per billion instructions
65-
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
59+
- All calculations assume a 13-node subnet
60+
- Cycles are calculated using the formula: base_fee + per_instruction_fee \* number_of_instructions
61+
- base_fee: 5_000_000 cycles
62+
- per_instruction_fee: 1 cycle
63+
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.37 (as of June 27, 2025)
6664

6765
For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
68-
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).
66+
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/references/cycles-cost-formulas).

‎examples/experimental/demo/hello_world_http_server/benchmarks.json‎

Lines changed: 9 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,27 @@
11
{
22
"backend": {
33
"previous": {
4-
"version": "0.30.0",
4+
"version": "0.32.0",
55
"benchmarks": [
66
{
7-
"instructions": {
8-
"__bigint__": "7522070511"
9-
},
7+
"instructions": "7736401550",
108
"method_name": "init",
11-
"timestamp": {
12-
"__bigint__": "1741977052653848208"
13-
}
9+
"timestamp": "1750853904404847437"
1410
},
1511
{
16-
"instructions": {
17-
"__bigint__": "53315260"
18-
},
12+
"instructions": "53363901",
1913
"method_name": "http_request_update",
20-
"timestamp": {
21-
"__bigint__": "1741977065768560859"
22-
}
14+
"timestamp": "1750853918580417646"
2315
}
2416
]
2517
},
2618
"current": {
27-
"version": "0.32.0",
19+
"version": "0.33.0",
2820
"benchmarks": [
2921
{
30-
"instructions": "7736401550",
31-
"method_name": "init",
32-
"timestamp": "1750853904404847437"
33-
},
34-
{
35-
"instructions": "53363901",
36-
"method_name": "http_request_update",
37-
"timestamp": "1750853918580417646"
22+
"instructions": "46220281",
23+
"method_name": "1",
24+
"timestamp": "1755791349384293414"
3825
}
3926
]
4027
}

‎examples/experimental/demo/hello_world_http_server/benchmarks.md‎

Lines changed: 15 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -1,28 +1,26 @@
11
# Benchmarks for backend
22

3-
## Current benchmarks Azle version: 0.32.0
3+
## Current benchmarks Azle version: 0.33.0
4+
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls | Change |
5+
|-----------|-------------|------------|--------|-----|--------------|-------|
6+
| 0 | 1 | 46_220_281 | 51_220_281 | $0.0000701718 | $70.17 | <font color="green">-7_690_181_269</font> |
47

5-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls | Change |
6-
| --- | ------------------- | ------------- | ------------- | ------------- | ----------------- | ------------------------------------- |
7-
| 0 | init | 7_736_401_550 | 5_895_150_620 | $0.0078386049 | $7_838.60 | <font color="red">+214_331_039</font> |
8-
| 1 | http_request_update | 53_363_901 | 21_935_560 | $0.0000291671 | $29.16 | <font color="red">+48_641</font> |
8+
## Baseline benchmarks Azle version: 0.32.0
9+
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
10+
|-----------|-------------|------------|--------|-----|--------------|
11+
| 0 | init | 7_736_401_550 | 7_741_401_550 | $0.0106057201 | $10_605.72 |
12+
| 1 | http_request_update | 53_363_901 | 58_363_901 | $0.0000799585 | $79.95 |
913

10-
## Baseline benchmarks Azle version: 0.30.0
1114

12-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
13-
| --- | ------------------- | ------------- | ------------- | ------------- | ----------------- |
14-
| 0 | init | 7_522_070_511 | 5_809_418_204 | $0.0077246091 | $7_724.60 |
15-
| 1 | http_request_update | 53_315_260 | 21_916_104 | $0.0000291412 | $29.14 |
1615

1716
---
1817

1918
**Note on calculations:**
20-
21-
- Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
22-
- base_fee: 590_000 cycles
23-
- per_instruction_fee: 0.4 cycles
24-
- additional_fee_per_billion: 400_000_000 cycles per billion instructions
25-
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
19+
- All calculations assume a 13-node subnet
20+
- Cycles are calculated using the formula: base_fee + per_instruction_fee \* number_of_instructions
21+
- base_fee: 5_000_000 cycles
22+
- per_instruction_fee: 1 cycle
23+
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.37 (as of June 27, 2025)
2624

2725
For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
28-
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).
26+
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/references/cycles-cost-formulas).

‎examples/experimental/test/end_to_end/http_server/apollo_server/benchmarks.json‎

Lines changed: 4 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,6 @@
11
{
22
"apollo_server": {
33
"previous": {
4-
"version": "0.30.0",
5-
"benchmarks": [
6-
{
7-
"instructions": {
8-
"__bigint__": "11090433633"
9-
},
10-
"method_name": "init",
11-
"timestamp": {
12-
"__bigint__": "1741977000372966099"
13-
}
14-
}
15-
]
16-
},
17-
"current": {
184
"version": "0.32.0",
195
"benchmarks": [
206
{
@@ -23,6 +9,10 @@
239
"timestamp": "1750853914456815167"
2410
}
2511
]
12+
},
13+
"current": {
14+
"version": "0.33.0",
15+
"benchmarks": []
2616
}
2717
}
2818
}

‎examples/experimental/test/end_to_end/http_server/apollo_server/benchmarks.md‎

Lines changed: 12 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,26 +1,23 @@
11
# Benchmarks for apollo_server
22

3-
## Current benchmarks Azle version: 0.32.0
3+
## Current benchmarks Azle version: 0.33.0
4+
No benchmarks reported
45

5-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls | Change |
6-
| --- | ----------- | -------------- | ------------- | ------------- | ----------------- | ------------------------------------- |
7-
| 0 | init | 11_359_532_116 | 8_944_402_846 | $0.0118931041 | $11_893.10 | <font color="red">+269_098_483</font> |
6+
## Baseline benchmarks Azle version: 0.32.0
7+
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
8+
|-----------|-------------|------------|--------|-----|--------------|
9+
| 0 | init | 11_359_532_116 | 11_364_532_116 | $0.0155694090 | $15_569.40 |
810

9-
## Baseline benchmarks Azle version: 0.30.0
1011

11-
| Id | Method Name | Instructions | Cycles | USD | USD/Million Calls |
12-
| --- | ----------- | -------------- | ------------- | ------------- | ----------------- |
13-
| 0 | init | 11_090_433_633 | 8_836_763_453 | $0.0117499793 | $11_749.97 |
1412

1513
---
1614

1715
**Note on calculations:**
18-
19-
- Cycles are calculated using the formula: base_fee + (per_instruction_fee \* number_of_instructions) + (additional_fee_per_billion \* floor(number_of_instructions / 1_000_000_000))
20-
- base_fee: 590_000 cycles
21-
- per_instruction_fee: 0.4 cycles
22-
- additional_fee_per_billion: 400_000_000 cycles per billion instructions
23-
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.329670 (as of October 24, 2024)
16+
- All calculations assume a 13-node subnet
17+
- Cycles are calculated using the formula: base_fee + per_instruction_fee \* number_of_instructions
18+
- base_fee: 5_000_000 cycles
19+
- per_instruction_fee: 1 cycle
20+
- USD value is derived from the total cycles, where 1 trillion cycles = 1 XDR, and 1 XDR = $1.37 (as of June 27, 2025)
2421

2522
For the most up-to-date XDR to USD conversion rate, please refer to the [IMF website](https://www.imf.org/external/np/fin/data/rms_sdrv.aspx).
26-
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/current/developer-docs/gas-cost#execution).
23+
For the most current fee information, please check the [official documentation](https://internetcomputer.org/docs/references/cycles-cost-formulas).

‎examples/experimental/test/end_to_end/http_server/audio_and_video/benchmarks.json‎

Lines changed: 4 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,6 @@
11
{
22
"backend": {
33
"previous": {
4-
"version": "0.30.0",
5-
"benchmarks": [
6-
{
7-
"instructions": {
8-
"__bigint__": "7523181611"
9-
},
10-
"method_name": "init",
11-
"timestamp": {
12-
"__bigint__": "1741976997769584185"
13-
}
14-
}
15-
]
16-
},
17-
"current": {
184
"version": "0.32.0",
195
"benchmarks": [
206
{
@@ -23,6 +9,10 @@
239
"timestamp": "1750853911128559351"
2410
}
2511
]
12+
},
13+
"current": {
14+
"version": "0.33.0",
15+
"benchmarks": []
2616
}
2717
}
2818
}

0 commit comments

Comments
 (0)