Anisotropic proximal gradient

• 成果类型: Article; Early Access
• 署名作者: Laude, Emanuel; Patrinos, Panagiotis
• 署名单位: KU Leuven
• 刊物名称: MATHEMATICAL PROGRAMMING
• ISSN/ISSBN: 0025-5610
• DOI: 10.1007/s10107-025-02204-5
• 发表日期: 2025
• 关键词: 1st-order methods; strong convexity; optimization; CONVERGENCE; Duality

摘要

This paper studies a novel algorithm for nonconvex composite minimization which can be interpreted in terms of dual space nonlinear preconditioning for the classical proximal gradient method. The proposed scheme can be applied to additive composite minimization problems whose smooth part exhibits an anisotropic descent inequality relative to a reference function. It is proved that the anisotropic descent property is closed under pointwise average if the Bregman distance generated by the conjugate reference function is jointly convex. More specifically, for the exponential reference function we prove its closedness under pointwise conic combinations. We analyze the method's asymptotic convergence and prove its linear convergence under an anisotropic proximal gradient dominance condition. Applications are discussed including exponentially regularized LPs and logistic regression with nonsmooth regularization. In numerical experiments we show significant improvements of the proposed method over its Euclidean counterparts.