Convergent Nested Alternating Minimization Algorithms for Nonconvex Optimization Problems

• 成果类型: Article
• 署名作者: Gur, Eyal; Sabach, Shoham; Shtern, Shimrit
• 署名单位: Technion Israel Institute of Technology
• 刊物名称: MATHEMATICS OF OPERATIONS RESEARCH
• ISSN/ISSBN: 0364-765X
• DOI: 10.1287/moor.2022.1256
• 发表日期: 2023
• 页码: 53-77
• 关键词: linearized minimization; tikhonov regularization; proximal algorithm

摘要

We introduce a new algorithmic framework for solving nonconvex optimization problems, that is called nested alternating minimization, which aims at combining the classical alternating minimization technique with inner iterations of any optimization method. We provide a global convergence analysis of the new algorithmic framework to critical points of the problem at hand, which to the best of our knowledge, is the first of this kind for nested methods in the nonconvex setting. Central to our global convergence analysis is a new extension of classical proof techniques in the nonconvex setting that allows for errors in the conditions. The power of our framework is illustrated with some numerical experiments that show the superiority of this algorithmic framework over existing methods.