Guaranteed Closed-Loop Learning in Model Predictive Control

• 成果类型: Article
• 署名作者: Soloperto, Raffaele; Muller, Matthias A.; Allgower, Frank
• 署名单位: University of Stuttgart; Leibniz University Hannover
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2022.3172453
• 发表日期: 2023
• 页码: 991-1006
• 关键词: Cost function; COSTS; uncertainty; trajectory; control systems; predictive models; Predictive control; Constrained control; closed loop learning; predictive control for nonlinear systems; Nonlinear systems

摘要

In this article, we propose a novel learning-based model predictive control framework for nonlinear systems which is able to guarantee closed-loop learning of the controlled system. We consider a cost function that combines a general economic cost with a user-defined learning cost function that aims at incentivizing learning of the unknown system. In particular, due to the finite horizon of the MPC scheme and to the presence of disturbances, the open-loop trajectory usually differs from the closed-loop one. Such a mismatch causes existing learning-based MPC schemes to only show a learning phase in the open-loop prediction, without providing any formal guarantee on the actual closed-loop learning. In this article, we show how existing MPC schemes can be easily modified in order to guarantee closed-loop learning of the system by including a suitable discount factor in the chosen learning cost function, and implementing an additional constraint in the original MPC scheme. We show that various techniques for online learning the system dynamics, such as kinky inference methods, Gaussian processes, or parametric approaches, can be used within the proposed general framework.