Skip to content

Commit 872cbd0

Browse files
Improve clarity in examples section of paper.md
1 parent a9a4985 commit 872cbd0

File tree

1 file changed

+4
-9
lines changed

1 file changed

+4
-9
lines changed

paper/paper.md

Lines changed: 4 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -138,11 +138,6 @@ We will illustrate this in the examples below.
138138

139139
# Examples
140140

141-
142-
We consider two examples where the smooth part $f$ is nonconvex and the nonsmooth part $h$ is either $\ell^{1/2}$ or $\ell_0$ norm with constraints.
143-
144-
We compare the performance of our solvers with (**PANOC**) solver [@stella-themelis-sopasakis-patrinos-2017] implemented in [ProximalAlgorithms.jl](https://github.com/JuliaFirstOrder/ProximalAlgorithms.jl).
145-
146141
We illustrate the capabilities of [RegularizedOptimization.jl](https://github.com/JuliaSmoothOptimizers/RegularizedOptimization.jl) on two nonsmooth and nonconvex problems:
147142

148143
- **Support Vector Machine (SVM) with $\ell^{1/2}$ penalty** for image classification [@aravkin-baraldi-orban-2024].
@@ -166,9 +161,9 @@ solve!(solver, reg_nlp, stats; x=f.meta.x0, atol=1e-5, rtol=1e-5, verbose=0, sub
166161
```
167162
The NNMF problem can be set up in a similar way, replacing the model by nnmf_model(...), $h$ by an $\ell_0$ norm and use an L-BFGS Hessian approximation.
168163

169-
### Numerical results
164+
## Numerical results
170165

171-
We compare **PANOC** (from [ProximalAlgorithms.jl](https://github.com/JuliaFirstOrder/ProximalAlgorithms.jl)) with **TR**, **R2N**, and **LM** from our library.
166+
We compare **PANOC** [@stella-themelis-sopasakis-patrinos-2017](from [ProximalAlgorithms.jl](https://github.com/JuliaFirstOrder/ProximalAlgorithms.jl)) with **TR**, **R2N**, and **LM** from our library.
172167
The results are summarized in the combined table below:
173168

174169
```
@@ -184,14 +179,14 @@ The results are summarized in the combined table below:
184179
└───────────────────┴─────────────┴──────────┴──────┴──────┴───────┘
185180
```
186181

187-
### Discussion
182+
## Discussion
188183

189184
- **SVM with $\ell^{1/2}$ penalty:** **TR** and **R2N** require far fewer function and gradient evaluations than **PANOC**, at the expense of more proximal iterations. Since each proximal step is inexpensive, **TR** and **R2N** are much faster overall.
190185
- **NNMF with constrained $\ell_0$ penalty:** **TR** outperforms **R2N**, while **LM** is competitive in terms of function calls but incurs many gradient evaluations.
191186

192187
Additional tests (e.g., other regularizers, constraint types, and scaling dimensions) have also been conducted, and a full benchmarking campaign is currently underway.
193188

194-
## Conclusion
189+
# Conclusion
195190

196191
The experiments highlight the effectiveness of the solvers implemented in [RegularizedOptimization.jl](https://github.com/JuliaSmoothOptimizers/RegularizedOptimization.jl) compared to **PANOC** from [ProximalAlgorithms.jl](https://github.com/JuliaFirstOrder/ProximalAlgorithms.jl).
197192

0 commit comments

Comments
 (0)