Skip to content

Commit d08995c

Browse files
committed
Update benchmarks with a new local run
1 parent d895105 commit d08995c

File tree

6 files changed

+159
-6
lines changed

6 files changed

+159
-6
lines changed

data/2025-04-28-16-09/Manifest

Lines changed: 139 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,139 @@
1+
Status `~/Code/benchmarks/Manifest.toml`
2+
[47edcb42] ADTypes v1.14.0
3+
[79e6a3ab] Adapt v4.3.0
4+
[4fba245c] ArrayInterface v7.18.0
5+
[6e4b80f9] BenchmarkTools v1.6.0
6+
[d1d4a3ce] BitFlags v0.1.9
7+
[336ed68f] CSV v0.10.15
8+
[523fee87] CodecBzip2 v0.8.5
9+
[944b1d66] CodecZlib v0.7.8
10+
[bbf7d656] CommonSubexpressions v0.3.1
11+
[34da2185] Compat v4.16.0
12+
[f0e56b4a] ConcurrentUtilities v2.5.0
13+
[187b0558] ConstructionBase v1.5.8
14+
[a8cc5b0e] Crayons v4.1.1
15+
[9a962f9c] DataAPI v1.16.0
16+
[a93c6f00] DataFrames v1.7.0
17+
[864edb3b] DataStructures v0.18.22
18+
[e2d170a0] DataValueInterfaces v1.0.0
19+
[163ba53b] DiffResults v1.1.0
20+
[b552c78f] DiffRules v1.15.1
21+
[a0c0ee7d] DifferentiationInterface v0.6.52
22+
[b4f34e82] Distances v0.10.12
23+
[ffbed154] DocStringExtensions v0.9.4
24+
[460bff9d] ExceptionUnwrapping v0.1.11
25+
[48062228] FilePathsBase v0.9.24
26+
[6a86dc24] FiniteDiff v2.27.0
27+
[f6369f11] ForwardDiff v1.0.1
28+
[bc5e4493] GitHub v5.9.0
29+
[2e9cd046] Gurobi v1.7.4
30+
[cd3eb016] HTTP v1.10.16
31+
[2030c09a] InfrastructureModels v0.7.8
32+
[842dd82b] InlineStrings v1.4.3
33+
[41ab1584] InvertedIndices v1.3.1
34+
[b6b21f68] Ipopt v1.10.2
35+
[92d709cd] IrrationalConstants v0.2.4
36+
[82899510] IteratorInterfaceExtensions v1.0.0
37+
[692b3bcd] JLLWrappers v1.7.0
38+
[682c06a0] JSON v0.21.4
39+
[0f8b85d8] JSON3 v1.14.2
40+
[4076af6c] JuMP v1.25.0
41+
[b964fa9f] LaTeXStrings v1.4.0
42+
[d3d80556] LineSearches v7.3.0
43+
[2ab3a3ac] LogExpFunctions v0.3.29
44+
[e6f89c97] LoggingExtras v1.1.0
45+
[1914dd2f] MacroTools v0.5.16
46+
[b8f27783] MathOptInterface v1.39.0
47+
[739be429] MbedTLS v1.1.9
48+
[f28f55f0] Memento v1.4.1
49+
[e1d29d7a] Missings v1.2.0
50+
[d8a4904e] MutableArithmetics v1.6.4
51+
[d41bc354] NLSolversBase v7.9.1
52+
[2774e3e8] NLsolve v4.5.1
53+
[77ba4419] NaNMath v1.1.3
54+
[4d8831e6] OpenSSL v1.4.3
55+
[bac558e1] OrderedCollections v1.8.0
56+
[d96e819e] Parameters v0.12.3
57+
[69de0a69] Parsers v2.8.3
58+
[2dfb63ee] PooledArrays v1.4.3
59+
[c36e90e8] PowerModels v0.21.3
60+
⌅ [aea7be01] PrecompileTools v1.2.1
61+
[21216c6a] Preferences v1.4.3
62+
[08abe8d2] PrettyTables v2.4.0
63+
[189a3867] Reexport v1.2.2
64+
[ae029012] Requires v1.3.1
65+
[91c51154] SentinelArrays v1.4.8
66+
[efcf1570] Setfield v1.1.2
67+
[777ac1f9] SimpleBufferStream v1.2.0
68+
[2133526b] SodiumSeal v0.1.1
69+
[a2af1166] SortingAlgorithms v1.2.1
70+
[276daf66] SpecialFunctions v2.5.1
71+
[1e83bf80] StaticArraysCore v1.4.3
72+
[82ae8749] StatsAPI v1.7.0
73+
[892a3eda] StringManipulation v0.4.1
74+
[856f2bd8] StructTypes v1.11.0
75+
[3783bdb8] TableTraits v1.0.1
76+
[bd369af6] Tables v1.12.0
77+
[3bb67fe8] TranscodingStreams v0.11.3
78+
[5c2747f8] URIs v1.5.2
79+
[3a884ed6] UnPack v1.0.2
80+
[ea10d353] WeakRefStrings v1.4.2
81+
[76eceee3] WorkerUtilities v1.6.1
82+
[ae81ac8f] ASL_jll v0.1.3+0
83+
[6e34b625] Bzip2_jll v1.0.9+0
84+
[c018c7e6] Gurobi_jll v12.0.1
85+
[e33a78d0] Hwloc_jll v2.12.0+0
86+
[9cc047cb] Ipopt_jll v300.1400.1700+0
87+
[d00139f3] METIS_jll v5.1.3+0
88+
[d7ed1dd3] MUMPS_seq_jll v500.700.301+0
89+
⌅ [656ef2d0] OpenBLAS32_jll v0.3.24+0
90+
[458c3c95] OpenSSL_jll v3.5.0+0
91+
[efe28fd5] OpenSpecFun_jll v0.5.6+0
92+
⌅ [319450e9] SPRAL_jll v2024.5.8+0
93+
[a9144af2] libsodium_jll v1.0.21+0
94+
[0dad84c5] ArgTools v1.1.1
95+
[56f22d72] Artifacts
96+
[2a0f44e3] Base64
97+
[ade2ca70] Dates
98+
[8ba89e20] Distributed
99+
[f43a241f] Downloads v1.6.0
100+
[7b1f6079] FileWatching
101+
[9fa8497b] Future
102+
[b77e0a4c] InteractiveUtils
103+
[b27032c2] LibCURL v0.6.4
104+
[76f85450] LibGit2
105+
[8f399da3] Libdl
106+
[37e2e46d] LinearAlgebra
107+
[56ddb016] Logging
108+
[d6f4376e] Markdown
109+
[a63ad114] Mmap
110+
[ca575930] NetworkOptions v1.2.0
111+
[44cfe95a] Pkg v1.10.0
112+
[de0858da] Printf
113+
[9abbd945] Profile
114+
[3fa0cd96] REPL
115+
[9a3f8284] Random
116+
[ea8e919c] SHA v0.7.0
117+
[9e88b42a] Serialization
118+
[6462fe0b] Sockets
119+
[2f01184e] SparseArrays v1.10.0
120+
[10745b16] Statistics v1.10.0
121+
[fa267f1f] TOML v1.0.3
122+
[a4e569a6] Tar v1.10.0
123+
[8dfed614] Test
124+
[cf7118a7] UUIDs
125+
[4ec0a83e] Unicode
126+
[e66e0078] CompilerSupportLibraries_jll v1.1.1+0
127+
[deac9b47] LibCURL_jll v8.4.0+0
128+
[e37daf67] LibGit2_jll v1.6.4+0
129+
[29816b5a] LibSSH2_jll v1.11.0+1
130+
[c8ffd9c3] MbedTLS_jll v2.28.2+1
131+
[14a3606d] MozillaCACerts_jll v2023.1.10
132+
[4536629a] OpenBLAS_jll v0.3.23+4
133+
[05823500] OpenLibm_jll v0.8.1+4
134+
[bea87d4a] SuiteSparse_jll v7.2.1+1
135+
[83775a58] Zlib_jll v1.2.13+1
136+
[8e850b90] libblastrampoline_jll v5.11.0+0
137+
[8e850ede] nghttp2_jll v1.52.0+1
138+
[3f19e933] p7zip_jll v17.4.0+2
139+
Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`

data/2025-04-28-16-09/results.json

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"benchmark_p_median":{"time_median":4.320103335e8,"allocs":7513875,"gc_min":9.8929916e7,"gc_median":2.056000195e8,"memory":632312032,"time_min":3.36027625e8},"gurobi_facility.jl 75":{"time_median":9.473222083e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":9.473222083e9},"inverse_ising_register.jl logrise":{"time_median":4.3633884375e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3016,"time_min":4.361024625e9},"benchmark_print_AffExpr":{"time_median":48417.0,"allocs":1281,"gc_min":0.0,"gc_median":0.0,"memory":90960,"time_min":46458.0},"benchmark_vector_sum_010":{"time_median":3500.0,"allocs":182,"gc_min":0.0,"gc_median":0.0,"memory":16272,"time_min":3208.3333333333335},"gurobi_lqcp.jl 2000":{"time_median":3.211506375e10,"allocs":77,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":3.211506375e10},"benchmark_print_small_model":{"time_median":105709.0,"allocs":2578,"gc_min":0.0,"gc_median":0.0,"memory":186304,"time_min":100250.0},"benchmark_matrix_quadratic_product_010":{"time_median":1.017708e6,"allocs":4610,"gc_min":0.0,"gc_median":0.0,"memory":1781656,"time_min":960792.0},"benchmark_sparse_axis_constraints_index":{"time_median":960229.5,"allocs":27964,"gc_min":0.0,"gc_median":0.0,"memory":2291376,"time_min":907791.0},"inverse_ising_expr.jl logrise":{"time_median":4.207838771e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3000,"time_min":4.206481875e9},"benchmark_macro_quad_010":{"time_median":1.222225e7,"allocs":150909,"gc_min":0.0,"gc_median":0.0,"memory":16420416,"time_min":1.1942167e7},"gurobi_lqcp.jl 500":{"time_median":3.124345146e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3136,"time_min":3.119220625e9},"ipopt_jump_2788.jl 800":{"time_median":4.4091063745e9,"allocs":77,"gc_min":0.0,"gc_median":0.0,"memory":3168,"time_min":4.405088166e9},"benchmark_jump_creating_variable_dense_axis_array":{"time_median":217792.0,"allocs":7154,"gc_min":0.0,"gc_median":0.0,"memory":521872,"time_min":205959.0},"ipopt_jump_2788.jl 200":{"time_median":3.9399509585e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":3.936217042e9},"inverse_ising_register.jl rple":{"time_median":4.355626729e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3016,"time_min":4.354274666e9},"benchmark_matrix_affine_product_050":{"time_median":1.5272271e7,"allocs":85130,"gc_min":0.0,"gc_median":1.8021455e6,"memory":38362488,"time_min":1.3312792e7},"benchmark_array_sum_010":{"time_median":240042.0,"allocs":10155,"gc_min":0.0,"gc_median":0.0,"memory":725616,"time_min":228958.0},"ipopt_jump_2788.jl 400":{"time_median":4.2953515415e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":4.290480833e9},"benchmark_value_nonlinear_expression":{"time_median":3.494399785e8,"allocs":2900592,"gc_min":0.0,"gc_median":1.139385625e8,"memory":322982304,"time_min":2.34364666e8},"benchmark_macro_quad_050":{"time_median":2.01952575e9,"allocs":13711095,"gc_min":8.733425e7,"gc_median":2.36244502e8,"memory":1570549656,"time_min":1.85370625e9},"benchmark_jump_creating_model":{"time_median":1379.6666666666667,"allocs":90,"gc_min":0.0,"gc_median":0.0,"memory":9728,"time_min":1254.6666666666667},"benchmark_matrix_quadratic_product_050":{"time_median":6.97724083e8,"allocs":160132,"gc_min":1.07056833e8,"gc_median":1.27367791e8,"memory":966302632,"time_min":6.75501958e8},"benchmark_dense_axis_constraints_index":{"time_median":1.461958e6,"allocs":44928,"gc_min":0.0,"gc_median":0.0,"memory":3163104,"time_min":1.394375e6},"gurobi_facility.jl 100":{"time_median":2.1917301833e10,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":2.1917301833e10},"benchmark_print_model":{"time_median":51542.0,"allocs":1332,"gc_min":0.0,"gc_median":0.0,"memory":95344,"time_min":49750.0},"benchmark_jump_creating_small_constraints":{"time_median":1.56626083e8,"allocs":3397736,"gc_min":3.4396334e7,"gc_median":6.8182625e7,"memory":246441336,"time_min":1.25723125e8},"power_models_opf_acr.jl pglib_opf_case5_pjm":{"time_median":8.681798334e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3008,"time_min":8.681798334e9},"benchmark_vector_sum_050":{"time_median":12208.0,"allocs":435,"gc_min":0.0,"gc_median":0.0,"memory":43664,"time_min":10708.0},"benchmark_array_sum_050":{"time_median":4.5779333e7,"allocs":1250208,"gc_min":3.180833e6,"gc_median":5.557125e6,"memory":77415952,"time_min":4.22315e7},"ipopt_clnlbeam.jl 500":{"time_median":1.9276006458e10,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":1.9276006458e10},"benchmark_macro_linear_010":{"time_median":4.723417e6,"allocs":129047,"gc_min":0.0,"gc_median":0.0,"memory":12955552,"time_min":4.670167e6},"gurobi_lqcp.jl 1000":{"time_median":7.649156417e9,"allocs":77,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":7.649156417e9},"gurobi_lqcp.jl 1500":{"time_median":1.5768291542e10,"allocs":77,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":1.5768291542e10},"benchmark_macro_linear_050":{"time_median":7.98589334e8,"allocs":11183747,"gc_min":6.1609752e7,"gc_median":2.29501331e8,"memory":1288777304,"time_min":6.22006709e8},"benchmark_jump_creating_variable_sparse_axis_array":{"time_median":141375.0,"allocs":3649,"gc_min":0.0,"gc_median":0.0,"memory":233120,"time_min":136583.0},"benchmark_dense_axis_constraints_iterate":{"time_median":1.466e6,"allocs":44928,"gc_min":0.0,"gc_median":0.0,"memory":3163104,"time_min":1.395666e6},"benchmark_print_model_10000":{"time_median":4.454291e6,"allocs":110295,"gc_min":0.0,"gc_median":0.0,"memory":8050976,"time_min":4.397167e6},"benchmark_jump_creating_variable_array":{"time_median":222375.0,"allocs":7138,"gc_min":0.0,"gc_median":0.0,"memory":521360,"time_min":208750.0},"gurobi_facility.jl 50":{"time_median":3.9926982495e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":3.988712791e9},"inverse_ising_expr.jl rple":{"time_median":4.2246432495e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3000,"time_min":4.221714458e9},"inverse_ising_expr.jl rise":{"time_median":4.2190090835e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3000,"time_min":4.206282459e9},"benchmark_matrix_sum_050":{"time_median":534625.0,"allocs":20164,"gc_min":0.0,"gc_median":0.0,"memory":1391256,"time_min":509250.0},"benchmark_sparse_axis_constraints_iterate":{"time_median":964417.0,"allocs":27964,"gc_min":0.0,"gc_median":0.0,"memory":2291376,"time_min":912958.0},"benchmark_ipopt_fractional_power":{"time_median":1.773521e6,"allocs":3708,"gc_min":0.0,"gc_median":0.0,"memory":142880,"time_min":1.3025e6},"gurobi_facility.jl 25":{"time_median":2.124068875e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":2.122002625e9},"benchmark_matrix_sum_010":{"time_median":23000.0,"allocs":935,"gc_min":0.0,"gc_median":0.0,"memory":67608,"time_min":21709.0},"power_models_opf_acp.jl pglib_opf_case5_pjm":{"time_median":1.0795458875e10,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3008,"time_min":1.0795458875e10},"inverse_ising_register.jl rise":{"time_median":4.373968729e9,"allocs":73,"gc_min":0.0,"gc_median":0.0,"memory":3016,"time_min":4.3730755e9},"ipopt_clnlbeam.jl 50":{"time_median":4.971157271e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":4.953153208e9},"benchmark_matrix_affine_product_010":{"time_median":103541.0,"allocs":2709,"gc_min":0.0,"gc_median":0.0,"memory":374360,"time_min":100000.0},"ipopt_clnlbeam.jl 5":{"time_median":3.666820938e9,"allocs":76,"gc_min":0.0,"gc_median":0.0,"memory":3152,"time_min":3.633480417e9}}

data/2025-04-28-16-09/versioninfo

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
Julia Version 1.10.9
2+
Commit 5595d20a287 (2025-03-10 12:51 UTC)
3+
Build Info:
4+
Official https://julialang.org/ release
5+
Platform Info:
6+
OS: macOS (arm64-apple-darwin24.0.0)
7+
CPU: 8 × Apple M1
8+
WORD_SIZE: 64
9+
LIBM: libopenlibm
10+
LLVM: libLLVM-15.0.7 (ORCJIT, apple-m1)
11+
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)
12+
Environment:
13+
JULIA_CMD = julia

docs/assets/benchmarks.js

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ function plot_latency_chart(data, unit_scale, y_label) {
4343
var series = Object.keys(data).sort().filter(word => word.slice(0, 5) != "bench").map(function (key) {
4444
return {
4545
x: to_date(data[key]["dates"]),
46-
y: normalize(data[key]['time_min'], unit_scale),
46+
y: normalize(data[key]['time_min'], unit_scale),
4747
name: key,
4848
}
4949
});
@@ -62,7 +62,7 @@ function plot_chart(data, chart_key, unit_scale, y_label) {
6262
var series = Object.keys(data).sort().filter(word => word.slice(0, 5) == "bench").map(function (key) {
6363
return {
6464
x: to_date(data[key]["dates"]),
65-
y: normalize(data[key][chart_key], unit_scale),
65+
y: normalize(data[key][chart_key], unit_scale),
6666
name: key.slice(10, key.length),
6767
}
6868
});
@@ -82,9 +82,9 @@ function plot_summary_chart(data, series_info) {
8282
return {x: to_date(data["dates"]), y: data[item[0]], name: item[1]}
8383
});
8484
var layout = {
85-
margin: {b: 40, t: 20},
85+
margin: {b: 40, t: 20},
8686
hovermode: 'closest',
87-
yaxis: {title: 'Index (normalized to 100)', range: [0, 125]},
87+
yaxis: {title: 'Index (normalized to 100)'},
8888
legend: {"orientation": "h"}
8989
}
9090
Plotly.plot(chart, series, layout);

docs/data.json

Lines changed: 1 addition & 1 deletion
Large diffs are not rendered by default.

docs/summary_data.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
{"time_median":[100.0,98.97544329687463,99.3799034819304,98.23419894375101,100.65605804118557,101.53608196768157,98.70628678639653],"allocs":[100.0,98.16951435376214,97.6344053842526,97.64174807951146,97.60012095939335,97.5313019403095,98.06591687399919],"gc_min":[100.0,96.55720136382925,89.69211617484714,93.89330148322108,88.88446159394114,104.45376254712502,86.69266377161902],"gc_median":[100.0,95.29502104444941,90.79295044694845,101.23398380727248,98.82917514979611,99.92070032580055,104.59551855316253],"memory":[100.0,97.46350004684528,97.90734752631556,98.0065978956509,97.9047642951259,95.58883634060975,95.83109707745824],"dates":["2022-01-01-00-00","2022-02-01-00-00","2022-04-01-00-00","2022-05-01-00-00","2022-05-26-14-30","2022-07-22-10-43","2022-09-14-11-09"],"time_min":[100.0,99.09381835082405,99.44621153049016,98.1191933883807,100.55057346857348,101.80728878695837,98.50851357530388]}
1+
{"time_median":[100.0,98.97544329687463,99.3799034819304,98.23419894375101,100.65605804118557,101.53608196768157,98.70628678639653,45.36687408091695],"allocs":[100.0,98.16951435376214,97.6344053842526,97.64174807951146,97.60012095939335,97.5313019403095,98.06591687399919,95.3717629251851],"gc_min":[100.0,99.38887106929882,94.50517940612282,99.65446428384784,93.53533461849217,112.79057481446557,91.4847961583831,101.30052036638331],"gc_median":[100.0,95.29502104444941,90.79295044694845,101.23398380727248,98.82917514979611,99.92070032580055,104.59551855316253,134.35943051085818],"memory":[100.0,97.46350004684528,97.90734752631556,98.0065978956509,97.9047642951259,95.58883634060975,95.83109707745824,103.820339128604],"dates":["2022-01-01-00-00","2022-02-01-00-00","2022-04-01-00-00","2022-05-01-00-00","2022-05-26-14-30","2022-07-22-10-43","2022-09-14-11-09","2025-04-28-16-09"],"time_min":[100.0,99.09381835082405,99.44621153049016,98.1191933883807,100.55057346857348,101.80728878695837,98.50851357530388,43.89834702040619]}

0 commit comments

Comments
 (0)