sample change to benchmark

[dpo]

DO NOT MERGE

This is to test the bar plots introduced in JuliaSmoothOptimizers/JSOBenchmarks.jl#8.

[MaxenceGollier]

@dpo, it should work with reference_branch = origin/jsobmarks

[dpo]

That's odd. It used to work with just "main" or "jsobmarks". Did something change?

[MaxenceGollier]

I am not sure...
I didn't push anything.

[github-actions]

Gist: https://gist.github.com/dpo/1316f5836dc6d84ff6883aafa81d24d9

Full results stored as artifacts

Overview

this_commit_vs_reference_R2_time.svg

this_commit_vs_reference_R2_memory.svg

this_commit_vs_reference_R2_gctime.svg

this_commit_vs_reference_R2_allocations.svg

profiles_this_commit_vs_reference_R2.svg

Judgement

Benchmark Report for RegularizedOptimization

Job Properties

• Time of benchmarks:
  • Target: 16 Mar 2026 - 18:48
  • Baseline: 16 Mar 2026 - 18:49
• Package commits:
  • Target: 50b0838
  • Baseline: b79c357
• Julia commits:
  • Target: 5fe89b8
  • Baseline: 5fe89b8
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Brackets display tolerances for the benchmark estimates. Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["R2", "bpdn_l1"]	1.13 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["R2"]

Julia versioninfo

Target

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        379 s          0 s        117 s        117 s          0 s  
       #2  2400 MHz        386 s          0 s         97 s        130 s          0 s  
       #3  2400 MHz        382 s          0 s         91 s        140 s          0 s  
  Memory: 7.0 GB (143.265625 MB free)
  Uptime: 612.0 sec
  Load Avg:  17.88232421875  23.65478515625  15.52197265625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Baseline

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        406 s          0 s        125 s        119 s          0 s  
       #2  2400 MHz        415 s          0 s        103 s        132 s          0 s  
       #3  2400 MHz        409 s          0 s         98 s        142 s          0 s  
  Memory: 7.0 GB (105.046875 MB free)
  Uptime: 649.0 sec
  Load Avg:  18.38427734375  23.0419921875  15.66943359375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

this_commit

Benchmark Report for RegularizedOptimization

Job Properties

• Time of benchmark: 16 Mar 2026 - 18:48
• Package commit: 50b0838
• Julia commit: 5fe89b8
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["R2", "bpdn_B0"]	2.814 ms (5%)		633.86 KiB (1%)	922
["R2", "bpdn_l0"]	515.114 ms (5%)		3.30 MiB (1%)	177251
["R2", "bpdn_l1"]	2.432 ms (5%)		336.62 KiB (1%)	666

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        379 s          0 s        117 s        117 s          0 s  
       #2  2400 MHz        386 s          0 s         97 s        130 s          0 s  
       #3  2400 MHz        382 s          0 s         91 s        140 s          0 s  
  Memory: 7.0 GB (143.265625 MB free)
  Uptime: 612.0 sec
  Load Avg:  17.88232421875  23.65478515625  15.52197265625
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Reference

Benchmark Report for RegularizedOptimization

Job Properties

• Time of benchmark: 16 Mar 2026 - 18:49
• Package commit: b79c357
• Julia commit: 5fe89b8
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["R2", "bpdn_B0"]	2.693 ms (5%)		633.86 KiB (1%)	922
["R2", "bpdn_l0"]	502.085 ms (5%)		3.30 MiB (1%)	177108
["R2", "bpdn_l1"]	2.153 ms (5%)		338.12 KiB (1%)	756

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        406 s          0 s        125 s        119 s          0 s  
       #2  2400 MHz        415 s          0 s        103 s        132 s          0 s  
       #3  2400 MHz        409 s          0 s         98 s        142 s          0 s  
  Memory: 7.0 GB (105.046875 MB free)
  Uptime: 649.0 sec
  Load Avg:  18.38427734375  23.0419921875  15.66943359375
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

[dpo]

@MaxenceGollier Does this look ok?

[MaxenceGollier]

Looks good, you can merge JuliaSmoothOptimizers/JSOBenchmarks.jl#8.