Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Barzilai–Borwein-like rules in proximal gradient schemes for ℓ1-regularized problems

Viola, Marco orcid logoORCID: 0000-0002-2140-8094, Crisci, Serena orcid logoORCID: 0000-0001-9130-8163, Rebegoldi, Simone orcid logoORCID: 0000-0002-1232-5481 and Toraldo, Gerardo orcid logoORCID: 0000-0001-9703-5557 (2024) Barzilai–Borwein-like rules in proximal gradient schemes for ℓ1-regularized problems. Optimization Methods and Software, 39 (3). pp. 601-633. ISSN 1055-6788

Abstract
We propose a novel steplength selection rule in proximal gradient methods for minimizing the sum of a differentiable function plus an ℓ1-norm penalty term. The proposed rule modifies one of the classical Barzilai–Borwein steplength, extending analogous results obtained in the context of gradient projection methods for constrained optimization. We analyse the spectral properties of the Barzilai–Borwein-like steplength when the differentiable part is quadratic, showing that its reciprocal lies in the spectrum of the submatrix of the Hessian that depends on both the nonzero and the nonoptimal zero components of the current iterate, allowing for acceleration effects when the optimal zero components start to be identified. Furthermore, we insert the modified rule into a proximal gradient method with a nonmonotone line search, for which we prove global convergence towards a stationary point. Numerical experiments show the ability of the proposed rule to sweep the spectrum of the reduced Hessian on a series of quadratic ℓ1-regularized problems, as well as its effectiveness in recovering the ground truth in a least squares regularized problem arising in image restoration.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:Proximal gradient methods; Barzilai-Borwein rules
Subjects:Mathematics > Numerical analysis
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Science and Health > School of Mathematical Sciences
Publisher:Taylor & Francis
Official URL:https://www.tandfonline.com/doi/abs/10.1080/105567...
Copyright Information:Authors
ID Code:33427
Deposited On:11 Sep 2026 08:44 by Eimear Maher . Last Modified 11 Sep 2026 08:44
Documents

Full text available as:

[thumbnail of Viola_OMS2024_BBlasso copy.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0
12MB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record