Viola, Marco
ORCID: 0000-0002-2140-8094, Crisci, Serena
ORCID: 0000-0001-9130-8163, Rebegoldi, Simone
ORCID: 0000-0002-1232-5481 and Toraldo, Gerardo
ORCID: 0000-0001-9703-5557
(2024)
Barzilai–Borwein-like rules in proximal gradient schemes for ℓ1-regularized problems.
Optimization Methods and Software, 39
(3).
pp. 601-633.
ISSN 1055-6788
Abstract
We propose a novel steplength selection rule in proximal gradient methods for minimizing the sum of a differentiable function plus an ℓ1-norm penalty term. The proposed rule modifies one of the classical Barzilai–Borwein steplength, extending analogous results obtained in the context of gradient projection methods for constrained optimization. We analyse the spectral properties of the Barzilai–Borwein-like steplength when the differentiable part is quadratic, showing that its reciprocal lies in the spectrum of the submatrix of the Hessian that depends on both the nonzero and the nonoptimal zero components of the current iterate, allowing for acceleration effects when the optimal zero components start to be identified. Furthermore, we insert the modified rule into a proximal gradient method with a nonmonotone line search, for which we prove global convergence towards a stationary point. Numerical experiments show the ability of the proposed rule to sweep the spectrum of the reduced Hessian on a series of quadratic ℓ1-regularized problems, as well as its effectiveness in recovering the ground truth in a least squares regularized problem arising in image restoration.
Metadata
| Item Type: | Article (Published) |
|---|---|
| Refereed: | Yes |
| Uncontrolled Keywords: | Proximal gradient methods; Barzilai-Borwein rules |
| Subjects: | Mathematics > Numerical analysis |
| DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Science and Health > School of Mathematical Sciences |
| Publisher: | Taylor & Francis |
| Official URL: | https://www.tandfonline.com/doi/abs/10.1080/105567... |
| Copyright Information: | Authors |
| ID Code: | 33427 |
| Deposited On: | 11 Sep 2026 08:44 by Eimear Maher . Last Modified 11 Sep 2026 08:44 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 12MB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record