Regret-Optimal Estimation and Control

• 成果类型: Article
• 署名作者: Goel, Gautam; Hassibi, Babak
• 署名单位: University of California System; University of California Berkeley; California Institute of Technology
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2023.3253304
• 发表日期: 2023
• 页码: 3041-3053
• 关键词: estimation; COSTS; Heuristic algorithms; minimization; STANDARDS; Benchmark testing; Prediction algorithms; Filtering; Machine Learning; Robust control

摘要

In this article, we consider estimation and control in linear dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing causal state estimators and causal controllers, which compete against a clairvoyant noncausal policy, instead of the best policy selected in hindsight from some fixed parametric class. We show that regret-optimal filters and regret-optimal controllers can be derived in state space form using operator-theoretic techniques from robust control. Our results can be viewed as extending traditional robust estimation and control, which focuses on minimizing worst-case cost, to minimizing worst-case regret. We propose regret-optimal analogs of model-predictive control and the extended Kalman filter for systems with nonlinear dynamics and present numerical experiments which show that these algorithms can significantly outperform standard approaches to estimation and control.