Maximum Entropy Density Control of Discrete-Time Linear Systems With Quadratic Cost

• 成果类型: Article
• 署名作者: Ito, Kaito; Kashima, Kenji
• 署名单位: University of Tokyo; Kyoto University
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2024.3508550
• 发表日期: 2025
• 页码: 3024-3039
• 关键词: costs; entropy; Linear systems; uncertainty; Covariance matrices; closed-form solutions; State feedback; PROCESS CONTROL; mathematical models; Difference equations; maximum entropy (MaxEnt); optimal control; stochastic control

摘要

This article addresses the problem of steering the distribution of the state of a discrete-time linear system to a given target distribution while minimizing an entropy-regularized cost functional. This problem is called a maximum entropy density control problem. Specifically, the running cost is given by quadratic forms of the state and the control input, and the initial and target distributions are Gaussian. We first reveal that our problem boils down to solving two Riccati difference equations coupled through their boundary values. Based on them, we give the closed-form expression of the unique optimal policy. Next, we show that the optimal density control of a backward system can be obtained simultaneously with the forward-time optimal policy. The backward solution gives another expression of the forward solution. Finally, by considering the limit where the entropy regularization vanishes, we derive the unregularized density control in closed form.