Inexact accelerated high-order proximal-point methods

• 成果类型: Article
• 署名作者: Nesterov, Yurii
• 刊物名称: MATHEMATICAL PROGRAMMING
• ISSN/ISSBN: 0025-5610
• DOI: 10.1007/s10107-021-01727-x
• 发表日期: 2023
• 页码: 1-26
• 关键词: 1st-order methods; optimization

摘要

In this paper, we present a new framework of bi-level unconstrained minimization for development of accelerated methods in Convex Programming. These methods use approximations of the high-order proximal points, which are solutions of some auxiliary parametric optimization problems. For computing these points, we can use different methods, and, in particular, the lower-order schemes. This opens a possibility for the latter methods to overpass traditional limits of the Complexity Theory. As an example, we obtain a new second-order method with the convergence rate O (k(-4)),where k is the iteration counter. This rate is better than the maximal possible rate of convergence for this type of methods, as applied to functions with Lipschitz continuous Hessian. We also present newmethods with the exact auxiliary search procedure, which have the rate of convergence O (k(-(3p+1)/2)), where p >= 1 is the order of the proximal operator. The auxiliary problem at each iteration of these schemes is convex.