On the Analysis of Inexact Augmented Lagrangian Schemes for Misspecified Conic Convex Programs

• 成果类型: Article
• 署名作者: Aybat, Necdet Serhat; Ahmadi, Hesam; Shanbhag, Uday V.
• 署名单位: Pennsylvania Commonwealth System of Higher Education (PCSHE); Pennsylvania State University; Pennsylvania State University - University Park
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2021.3118340
• 发表日期: 2022
• 页码: 3981-3996
• 关键词: Algorithm design and analysis; augmented lagrangian methods; computational complexity; misspecified optimization; Optimization methods

摘要

In this article, we consider the misspecified optimization problem of minimizing a convex function f(x; theta*) in x over a conic constraint set represented by h(x; theta*) is an element of K, where theta* is an unknown (or misspecified) vector of parameters, K is a closed convex cone, and h is affine in x. Suppose that theta* is unavailable but may be learnt by a separate process that generates a sequence of estimators theta(k), each of which is an increasingly accurate approximation of theta*. We develop a first-order inexact augmented Lagrangian (AL) scheme for computing an optimal solution x* corresponding to theta* while simultaneously learning theta*. In particular, we derive rate statements for such schemes when the penalty parameter sequence is either constant or increasing and derive bounds on the overall complexity in terms of proximal gradient steps when AL subproblems are inexactly solved via an accelerated proximal gradient scheme. Numerical results for a portfolio optimization problem with a misspecified covariance matrix suggest that these schemes perform well in practice, while naive sequential schemes may perform poorly in comparison.