fork: python
ref: 2f60b8f02fe7cb83dd58
machine: windows-amd64
commit hash: 2f60b8f
commit date: 2025-11-01
overall geometric mean: 1.089x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.05x slower
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
2to3
216 ms
213 ms: 1.01x faster
docutils
1.59 sec
2.70 sec: 1.70x slower
html5lib
36.6 ms
38.4 ms: 1.05x slower
sphinx
616 ms
630 ms: 1.02x slower
Geometric mean
(ref)
1.16x slower
Benchmarks with tag 'asyncio':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
async_tree_io_tg
370 ms
313 ms: 1.18x faster
async_tree_none_tg
157 ms
140 ms: 1.12x faster
async_tree_io
366 ms
332 ms: 1.10x faster
async_tree_cpu_io_mixed_tg
335 ms
305 ms: 1.10x faster
asyncio_websockets
149 ms
143 ms: 1.05x faster
async_tree_memoization_tg
189 ms
181 ms: 1.05x faster
async_tree_memoization
195 ms
199 ms: 1.02x slower
async_tree_cpu_io_mixed
322 ms
331 ms: 1.03x slower
asyncio_tcp
504 ms
528 ms: 1.05x slower
coroutines
14.1 ms
14.9 ms: 1.06x slower
async_generators
229 ms
256 ms: 1.12x slower
asyncio_tcp_ssl
1.36 sec
2.28 sec: 1.68x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (1): async_tree_none
Benchmarks with tag 'math':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
pidigits
145 ms
135 ms: 1.08x faster
float
43.3 ms
44.1 ms: 1.02x slower
nbody
65.6 ms
76.7 ms: 1.17x slower
Geometric mean
(ref)
1.03x slower
Benchmarks with tag 'regex':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
regex_v8
13.7 ms
13.2 ms: 1.03x faster
regex_dna
116 ms
114 ms: 1.02x faster
regex_effbot
1.46 ms
1.53 ms: 1.05x slower
regex_compile
79.9 ms
88.1 ms: 1.10x slower
Geometric mean
(ref)
1.02x slower
Benchmarks with tag 'serialize':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
pickle_list
3.20 us
3.02 us: 1.06x faster
pickle_dict
19.4 us
19.9 us: 1.03x slower
xml_etree_parse
86.6 ms
89.0 ms: 1.03x slower
xml_etree_iterparse
58.6 ms
60.4 ms: 1.03x slower
pickle_pure_python
210 us
224 us: 1.06x slower
unpickle_list
2.78 us
2.99 us: 1.08x slower
xml_etree_generate
55.3 ms
60.4 ms: 1.09x slower
json_dumps
5.43 ms
5.95 ms: 1.10x slower
unpickle_pure_python
134 us
148 us: 1.10x slower
xml_etree_process
38.6 ms
43.1 ms: 1.12x slower
json_loads
14.0 us
15.6 us: 1.12x slower
unpickle
8.28 us
9.87 us: 1.19x slower
tomli_loads
1.37 sec
2.26 sec: 1.65x slower
Geometric mean
(ref)
1.10x slower
Benchmark hidden because not significant (1): pickle
Benchmarks with tag 'startup':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
python_startup_no_site
19.4 ms
19.0 ms: 1.02x faster
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (1): python_startup
Benchmarks with tag 'template':
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
django_template
23.4 ms
25.8 ms: 1.11x slower
genshi_xml
34.3 ms
38.0 ms: 1.11x slower
genshi_text
15.5 ms
18.4 ms: 1.19x slower
mako
6.72 ms
9.61 ms: 1.43x slower
Geometric mean
(ref)
1.20x slower
Benchmark
results/bm-20251101-3.15.0a1+-2f60b8f/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
results/bm-20251101-3.15.0a1+-2f60b8f-NOGIL/bm-20251101-pythonperf1_win32-amd64-python-2f60b8f02fe7cb83dd58-3.15.0a1+-2f60b8f.json
gc_traversal
2.05 ms
1.15 ms: 1.79x faster
create_gc_cycles
1.28 ms
1.01 ms: 1.27x faster
bench_mp_pool
88.7 ms
72.3 ms: 1.23x faster
async_tree_io_tg
370 ms
313 ms: 1.18x faster
async_tree_none_tg
157 ms
140 ms: 1.12x faster
sqlite_synth
1.57 us
1.40 us: 1.12x faster
async_tree_io
366 ms
332 ms: 1.10x faster
async_tree_cpu_io_mixed_tg
335 ms
305 ms: 1.10x faster
pidigits
145 ms
135 ms: 1.08x faster
pickle_list
3.20 us
3.02 us: 1.06x faster
asyncio_websockets
149 ms
143 ms: 1.05x faster
async_tree_memoization_tg
189 ms
181 ms: 1.05x faster
regex_v8
13.7 ms
13.2 ms: 1.03x faster
python_startup_no_site
19.4 ms
19.0 ms: 1.02x faster
regex_dna
116 ms
114 ms: 1.02x faster
2to3
216 ms
213 ms: 1.01x faster
dulwich_log
39.3 ms
39.8 ms: 1.01x slower
float
43.3 ms
44.1 ms: 1.02x slower
pathlib
28.3 ms
28.8 ms: 1.02x slower
comprehensions
11.2 us
11.5 us: 1.02x slower
sphinx
616 ms
630 ms: 1.02x slower
async_tree_memoization
195 ms
199 ms: 1.02x slower
pickle_dict
19.4 us
19.9 us: 1.03x slower
async_tree_cpu_io_mixed
322 ms
331 ms: 1.03x slower
xml_etree_parse
86.6 ms
89.0 ms: 1.03x slower
pylint
196 ms
202 ms: 1.03x slower
xml_etree_iterparse
58.6 ms
60.4 ms: 1.03x slower
deltablue
2.23 ms
2.31 ms: 1.04x slower
asyncio_tcp
504 ms
528 ms: 1.05x slower
html5lib
36.6 ms
38.4 ms: 1.05x slower
pyflate
283 ms
297 ms: 1.05x slower
regex_effbot
1.46 ms
1.53 ms: 1.05x slower
coroutines
14.1 ms
14.9 ms: 1.06x slower
logging_silent
55.2 ns
58.3 ns: 1.06x slower
sqlglot_v2_normalize
70.6 ms
74.8 ms: 1.06x slower
deepcopy_memo
17.8 us
18.9 us: 1.06x slower
spectral_norm
65.1 ms
69.1 ms: 1.06x slower
pickle_pure_python
210 us
224 us: 1.06x slower
sqlglot_v2_optimize
33.9 ms
36.1 ms: 1.06x slower
sympy_str
167 ms
178 ms: 1.06x slower
logging_simple
6.01 us
6.40 us: 1.06x slower
unpack_sequence
32.6 ns
35.0 ns: 1.07x slower
json
2.83 ms
3.03 ms: 1.07x slower
sympy_sum
85.3 ms
91.5 ms: 1.07x slower
sympy_expand
283 ms
303 ms: 1.07x slower
unpickle_list
2.78 us
2.99 us: 1.08x slower
pprint_safe_repr
497 ms
535 ms: 1.08x slower
hexiom
4.12 ms
4.44 ms: 1.08x slower
logging_format
6.39 us
6.92 us: 1.08x slower
many_optionals
548 us
596 us: 1.09x slower
chaos
41.1 ms
44.7 ms: 1.09x slower
xml_etree_generate
55.3 ms
60.4 ms: 1.09x slower
json_dumps
5.43 ms
5.95 ms: 1.10x slower
generators
19.2 ms
21.1 ms: 1.10x slower
regex_compile
79.9 ms
88.1 ms: 1.10x slower
unpickle_pure_python
134 us
148 us: 1.10x slower
deepcopy
165 us
182 us: 1.10x slower
django_template
23.4 ms
25.8 ms: 1.11x slower
genshi_xml
34.3 ms
38.0 ms: 1.11x slower
scimark_sor
76.6 ms
84.8 ms: 1.11x slower
sqlglot_v2_parse
844 us
936 us: 1.11x slower
sqlglot_v2_transpile
1.03 ms
1.15 ms: 1.11x slower
xml_etree_process
38.6 ms
43.1 ms: 1.12x slower
go
76.6 ms
85.6 ms: 1.12x slower
json_loads
14.0 us
15.6 us: 1.12x slower
async_generators
229 ms
256 ms: 1.12x slower
fannkuch
267 ms
299 ms: 1.12x slower
sympy_integrate
12.2 ms
13.7 ms: 1.12x slower
scimark_lu
56.2 ms
63.2 ms: 1.12x slower
deepcopy_reduce
1.77 us
2.00 us: 1.13x slower
richards
27.7 ms
31.3 ms: 1.13x slower
scimark_fft
169 ms
192 ms: 1.13x slower
raytrace
178 ms
203 ms: 1.14x slower
thrift
494 us
562 us: 1.14x slower
subparsers
30.7 ms
34.9 ms: 1.14x slower
nqueens
63.3 ms
72.1 ms: 1.14x slower
telco
4.17 ms
4.85 ms: 1.16x slower
richards_super
31.4 ms
36.6 ms: 1.17x slower
nbody
65.6 ms
76.7 ms: 1.17x slower
typing_runtime_protocols
103 us
121 us: 1.18x slower
crypto_pyaes
47.9 ms
56.5 ms: 1.18x slower
meteor_contest
72.0 ms
85.1 ms: 1.18x slower
genshi_text
15.5 ms
18.4 ms: 1.19x slower
scimark_sparse_mat_mult
2.47 ms
2.94 ms: 1.19x slower
unpickle
8.28 us
9.87 us: 1.19x slower
mdp
812 ms
973 ms: 1.20x slower
scimark_monte_carlo
41.0 ms
49.3 ms: 1.20x slower
bench_thread_pool
833 us
1.01 ms: 1.21x slower
coverage
48.0 ms
66.3 ms: 1.38x slower
mako
6.72 ms
9.61 ms: 1.43x slower
pprint_pformat
1.00 sec
1.54 sec: 1.54x slower
tomli_loads
1.37 sec
2.26 sec: 1.65x slower
asyncio_tcp_ssl
1.36 sec
2.28 sec: 1.68x slower
k_core
1.56 sec
2.62 sec: 1.68x slower
docutils
1.59 sec
2.70 sec: 1.70x slower
bpe_tokeniser
2.98 sec
5.28 sec: 1.78x slower
shortest_path
352 ms
632 ms: 1.80x slower
connected_components
327 ms
600 ms: 1.83x slower
Geometric mean
(ref)
1.10x slower
Benchmark hidden because not significant (4): async_tree_none, python_startup, pickle, pycparser
Geometric mean (including insignificant results): 1.089x slower
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.06x
95% likely to have a slowdown of 1.05x
99% likely to have a slowdown of 1.05x