Skip to content

Commit b12b10c

Browse files
authored
Attempt to minimize noise (#777)
from_idx_limit_1 and from_idx_limit_10 benchmarks are fairly fast with each measurement ~100-120ms. I would like to add a bit more warmup iterations to attempt to make results a bit more stable. For me locally this change added ~10s to the benchmark runtime.
1 parent 354f5eb commit b12b10c

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

esql/challenges/default.json

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -46,14 +46,14 @@
4646
"operation": "from_idx_limit_1",
4747
"tags": ["esql_large_schema"],
4848
"clients": {{query_clients | default(1)}},
49-
"warmup-iterations": 10,
49+
"warmup-iterations": 100,
5050
"iterations": {{query_iterations | default(100)}}
5151
},
5252
{
5353
"operation": "from_idx_limit_10",
5454
"tags": ["esql_large_schema"],
5555
"clients": {{query_clients | default(1)}},
56-
"warmup-iterations": 10,
56+
"warmup-iterations": 100,
5757
"iterations": {{query_iterations | default(100)}}
5858
},
5959
{
@@ -76,14 +76,14 @@
7676
"operation": "from_idx_limit_1_drop_null",
7777
"tags": ["esql_large_schema"],
7878
"clients": {{query_clients | default(1)}},
79-
"warmup-iterations": 10,
79+
"warmup-iterations": 100,
8080
"iterations": {{query_iterations | default(100)}}
8181
},
8282
{
8383
"operation": "from_idx_limit_10_drop_null",
8484
"tags": ["esql_large_schema"],
8585
"clients": {{query_clients | default(1)}},
86-
"warmup-iterations": 10,
86+
"warmup-iterations": 100,
8787
"iterations": {{query_iterations | default(100)}}
8888
},
8989
{

0 commit comments

Comments
 (0)