Online System Identification and Control for Linear Systems With Multiagent Controllers Over Wireless Interference Channels

• 成果类型: Article
• 署名作者: Tang, Minjie; Cai, Songfu; Lau, Vincent K. N.
• 署名单位: Hong Kong University of Science & Technology
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2022.3232054
• 发表日期: 2023
• 页码: 6020-6035
• 关键词: Lyapunov analysis; multiagent linear control systems; online system identification; optimal control; stochastic game

摘要

In this article, we consider identification and control for potentially unstable linear systems with multiagent controllers in the presence of wireless interference channels among the remote controllers and the actuators. We formulate the optimal control problem as a stochastic game and utilize the stochastic approximation technique to learn the optimal control solutions and the plant dynamics simultaneously in an online manner. Using Lyapunov drift analysis, we show that the identified plant dynamics and the learned control solutions via the proposed algorithm can converge to the true plant dynamics and optimal control solutions, respectively. Furthermore, we also rigorously show the convergence speed of the proposed learning algorithm in terms of the online learning step sizes in the proposed algorithm. The proposed scheme is also compared with various state-of-art baselines and we show that significant performance gains can be achieved.